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ABSTRACT 



A computer processing technique is advanced which seeks 
to retain or improve data information context while reducing 
the dimensionality of data representation. Defining 
information context as the relative proximity of data 
points, a nonlinear transformation is analytically derived 
which utilizes Euclidean distance to one or more reference 
points to provide a measure of similarity "between data 
points. The nonarbitrary reference points are selectively 
manipulated to provide, given certain contraints, a unique 
mapping from high dimensional space to one or more 
dimensions for each point in space. The transformation 
process enhances class clustering and interclass separation 
in the lower dimensional representation. 
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technique yielded a significant ratio improvement in mapping 
from higher dimensional space into 2 dimensional space for 
all cases examined. 
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I. INTRODUCTION 



In the widest sense, ^patterns are the means by which we 
interpret the world.” 

WILLIAM S. MIESEL 



Data becomes meaningful information when it provides a 
perspective on known information. In its most general sense, 
the context of unknown information is judged by its 
relationship to known information. The most numerous pattern 
recognition mechanism on the planet Earth, man, primarily 
judges the meaning of new information on his past 
experiences. He interprets his senses relative to his 
personal environment and experiences. However, the methods 
by which man preceives new experiences relative to past 
experiences is not yet fully understood. 

Mathematical pattern recognition, using digital 
computers, attempts to emulate the human's skill at pattern 
recognition, albeit poorly, by relating new information to 
its own data base of accumulated information. The computer 
has the advantage of performing pattern recognition in high 
dimensional spaces, spaces incomprehensible to man. 

A. MOTIVATION 



Pattern recognition represents information as numerical 
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values. In supervised learning, numerical representations of 
Known objects are compared against numerical representations 
of unknown objects in an attempt to recognize the unknown 
object. The complexity of analysis rapidly increases as more 
and more measures of an object are collected. Each measure 
is, in numerical form, a descriptor of some attribute of an 
item, be it a physical object, an event in time, or some 
metaphysical relationship. The number of measures of a item 
of data define the number of dimensions in space in which 
the item exists. A sample of an object is defined to be one 
set of measurements of that object. The complexity of 
evaluating the meaning or identity of an sample increases 
exponentially as the number of dimensions in which the 
object is described. The fact that procedures which are 
analytically or computationally manageable in low dimensions 
become completely impractical with high dimensional 
representations is termed within the pattern recognition 
literature as the "curse of dimensionality" [1 ,2,3] . 

The significance of information is not in its 
representation but in its context. In classifying data 
relative to known information the concern is recognition, 
not representation. The premise of this research is that a 
transformation exist which will overcome, to some extent, 
the curse of dimensionality by reducing information 

while retaining context. Viewed 
this transformation will attempt to retain 



representation 

geometrically. 
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or 



enhance relative proximity of similiar information and 
separate the relative proximity between different 
information sources while reducing the number of dimensions 
in the representation. 

B. A RELATIVE PROXIMITY SCENARIO 

Consider the problem of an aircraft navigator equipped 
with a range only measuring device. The navigator knows the 
general location of his aircraft but would like to precisely 
fix his position. In doing so. he measures the distance to 
two landmarks conveniently available to him as in figure 



1.1. Re 


then 


circumscribes a cirle around 


each of the 


landmarks 


.each 


with 


a radius equal to the distance from the 


aircraft 


to that 


landmark 


. Unless he is exactly 


on the line 


drawn between 


the 


two 


references points the 


circles drawn 


will int 


ersect 


a t 


two 


points. By knowing 


his general 


position , 


that 


is , 


by 


knowing the aircraft's position 


Relative 


to that 


line, 


the nagivator can 


resolve the 


ambigui ty 


and 


select 


the correct intersection as his 



position . 

This example, greatly generalized and viewed from the 
perspective of the landmarks rather than the navigator, is 
the transformation developed in this thesis to reduce 
representation while retaining relative proximity of 
similiar information. 
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Figure 1.1 Aircraft position determined relative to two 
reference points. 
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C. SCOPE 



The generalized pattern recognition process is described 
to provide insight into the role of dimensionality 
reduction. Next the nonlinear transformation employed to 
reduce data representation is analytically derived. This is 
followed by geometric illustrations of the Transformation 
and a rationalization of its effects on class clustering. 
Results of specific test cases are described and graphically 
illustrated. The final chapter provides conclusions, 
recommendations for applications, and further research areas 
in this methodology. 
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II. THE PATTEP.N RECOGNITION PROCESS 



A. NATURE OF TEE PROCESS 

"Pattern classification is the assignment of a physical 
object or event to one of several prespecified catagories 
"[1]. The act of making that assignment can be characterized 
by three sequential logical component processes as shown in 
figure 2.1. In the first process, the physical world is 
sensed by some transducer system which transforms data into 
a machine processible state. The transducer changes the 
physical reality of an object, characterized as a continuum 
of parameters and infinite in dimensionality, into a pattern 
space whose domain is defined by the discretization of 
sensor data observed in the real world. This discrete set of 
measurements finitely bounds the range of values and number 
of dimensions which characterize the object. Feature space 
is an intermediate domain between pattern space and 
classification space. There may be one or more subprocesses 
required in transforming pattern space into feature space. 
This transformation into feature space is the process, 
termed feature selection, preprocessing, or feature 
extraction, by which a sample representation in pattern 
space is described by a finite and usually smaller sample 
representation called features. Feature space is a reduced 
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PHYSICAL V/ORLD 




CLASSIFICATION SPACE 



FIGURE 2.1 



The pattern recognition process 



1? 



representation which attempts to retain as much 
discriminating power as possible while removing as much 
redundancy as possible. The transformation from feature 
space to classification space is accomplished via a set of 
decision rules which classify an unlabeled (unknown) sample 



of an object as a member of one of the known data sets. The 
classification problem is basically one of partitioning the 



feature space into regions, one region for each category. 
The view of pattern recognition as a series of processes was 
provided by H. C. Andrews[3]. Meisel L2] views pattern 
recognition as a series of states in which the data exist. 
The two perspectives are logically equivalent. 



B. DIMENSIONALITY REDUCTION 



In 

feature 



describing 


the 


extraction 


Duda 



dimensionality reduction 
and Hart comment : 



inherent 



in 



There is a growing body of theory of dimensionality 
reduction for pattern classification. Some of these 
methods seek to form new features out of linear 
combinations of old ones. Others seek merely a small 
subset of the original features. A major problem 
confronting this theory is that the division of pattern 
recognition into feature extraction followed by 
classification is theoretically artificial. A completely 
optimal feature extractor can never be anything but an 
optimal classifier. [1] 



Andrews states : 



While the objective in defining the feature space is to 
reduce the dimensionality of the pattern space yet 
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maintaining discriminatory power for classi fiction 
purposes, successful transformations still seem in their 
infancy. There exist a variety of linear transformations 
as well as some nonlinear methods which are developing 
particular appeal hut the real frontiers of pattern 
recognition still lie ahead in developing a viable 
feature selection transformation that undoes the 
redundant data gathering Inherent in the definition of 
pattern space . [3] 

\ 

The variety of feature extraction techniques are too 
numerous to mention individually, hut can he discussed as 
families of methodologies. Principal component analysis 
techniques attempt to maintain discrimination while reducing 
the dimensionality of data representation hy selecting a 
subset of measurements from pattern space which contain the 
most variability. The objective of factor analysis is to 
find a lower dimensional representation that accounts for 
the correlations among the features. The multidimensional 
scaling technique reduces the dimensionality while 
attempting to maintain the distance relationships between 
all points in pattern space in feature space. This feature 
extractor iteratively processes the data until a minimum 
error exists in the feature space representation of pattern 
space distance relationships. Classical discriminant 
analysis attempts to find a lower dimensional surface on 
which to project the data samples and achieve good 
separation between classes. In each case the methodologies 
incur some loss of information in feature extraction. 

The intrinsic meaning of the data points, not their 
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representation, is their single most important property. An 
optimal feature extractor must not lose context while 
reducing data representation, Certainily, any feature 
extractor which reduces the context while reducing the 
representation is suhoptimal. Yet the term feature extractor 
itself implies retaining some information while discarding 
some information. Perhaps a change of perspective is 
required to better reduce data representations. Consider a 
method of representing in a lower dimension the 
relationships between data samples in pattern space rather 
than the data itself. The relationships are the significant 
factors, not the representations, for they define the 
context of the information. 

The relationships between data points are typically 
Judged in terms of distance measures. Meisel astutely noted 
"distance is crucial in pattern recognition* it is assumed, 
roughly, that the closer a point is to another point, the 
more similar are the patterns represented by those 
points”. [2] Multidimensional scaling capitalizes on this 
fact by attempting to retain pattern space distance 
relationships in feature space. Yet it fails to do so 
completely since the distance relationships between all 
points can not be explicitly retained in any less than the 
number of pattern space dimensions unless the points exist 
in a subspace within the pattern space. 

Again recall that the significant factor is context, not 
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representation. Tafcing the liberty of paraphasing 



Meisel 's 



words, the greater the relative proximity of one point to 
another point, the greater the similarity of the patterns 
represented by those points. If, in reducing the data 
representation dimensionality, the relative proximity of 
similar information is maintained then it seems intiutive 
that little loss of context has occured in the 
transformation. Multidimensional scaling severly constraints 
itself by attempting to maintain distance relationships in 
lower dimensions. The transformation presented here will 
forego maintaining distance relationships between all points 
in lieu of maintaining relative proximity between similar 
data points. ' 

C. GENERAL APPROACH TO A RELATIVE PROXIMITY TRANSFORMATION 

In developing this nonlinear transformation use is made 
of two axioms : 

1. the distance between two points in n dimensional space 
is a scalar value; 

2. an n dimensional lattice space is relatively sparse 
compared to n dimensional continuous space. 

These facts are of vital signifinance in the ability to 
reduce representation without loss of context. 

The distance from one point to another point is a 
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measure of the relative proximity of the points. In one 
dimension, the similarity or lack of similarity in distance 
from a reference point to all other points in effect defines 
each point's relative proximity to one another. By 
generalising to n dimensions and constraining the data space 
to remove ambiguity, the context of points in n dimensions 
may be measured by their similarity in distance to one or 
more known reference points. 

The selection of reference points will be based on a 
criterion of retaining, if not improving, relative proximity 



of similar 


representations , 


sepa ra ting 


di ssimi lar 


representations , 


and 


providing a 


unique 


mappi 


ng from n 


dimensional pattern 


space to an 


m (m 


> 1) 


dimensional 



feature space. 
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Ill 



N-DIMEN S ION AL NONLINEAR TRANSFORMATIONS 



This chapter considers the representation of known data 
samples in pattern space. Their representations in pattern 
space produce several constraints and assumptions about that 
space which allow nonlinear transformations to reduce the 
dimensionality of their representations. In subsequent 
chapters it will be shown that the reduced representation 
retains or, more likely, improves any clustering present in 
samples of the same object. This implies that the 
information context of the reduced representation is at 
least maintained if not improved in the lower dimension 
representation. The case of a two dimensional pattern space 
to two dimensional distance space transform is first 
developed, followed by a three dimensional pattern space to 
two dimensional distance space transformation. A discussion 
of n dimensional to m dimensional transforms conclude the 
chapter . 

A. DEFINITIONS 

Let X. = (x. . ,x_. ,..,x . ) be the i th sample vector 

i T-i 2i ni 

in pattern space describing an object where : 

Xj (j = l,n) is a real number; 

n is the finite number of dimensions in 
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the sample vector. 



Let D. = (d- . ,d. . , . . . ,d .) he the ordered representation of 
i lx 2i mi 

the i th sample in distance space 1 where : 



d k (k = l,m) 



m is the finite number of dimensions in 

the distance vector. 

is a real number 

where (d, ) is the Euclidean distance 
k 

from a designated reference point (R k ) 
to a sample point (r); 

The Euclidean distance (d^) is defined to have the following 
properties for any three distinct points (x. ,x. ,x ) i j : 

1 J K 

d(x it Xj) = t h ?| x hi “ x hj^ 2 ^ 1/2 d(x i# Xj) > 0 

d ( x i ,x i ) = 0 d (xi ,Xj ) = d(xj,x i ) 

d (x. ,x ) + d (x. ,x ) > d(x. ,x ) 

1 D D k - i k 

A nonlinear transformation (T) is defined such that 

T : ( X > D ) 

i i 



B. TRANSFORMATION FROM TVO DIMENSIONAL PATTERN SPACE INTO 
TWO DIMENSIONAL DISTANCE SPACE 

In considering the two dimensional transformation (T) 
recall the example of the navigator. In that situation, the 
navigator knew the aircraft's approximate position. 



The term 
space since 
rather than 
might be 
anaylsis . 



distance space is utilized in lieu of feature 
the features are distances from reference points 
a subset of measurements from pattern space as 
done , for example, in principal component 
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effectively limiting the area in which he could he precisely 
located. In the general case in two dimensions one method to 
locate a point in space precisely is to constrain that point 
to a certain region as in the case of the navigator. In 
constraining a point to remove ambiguity two factors enter 
into consideration. In supervised learning an attempt is 
made to identify an object solely on its proximity to other 
identified points. The range of values of the known objects 
are precisely defined and the unknown sample values will be 
approximately equal to the known values. Secondly, recall 
that the navigator had to know his general position relative 
to a line drawn between the two reference points to resolve 
the ambiguity in choosing which of the two intersections was 
his position. Knowing the approximate range of values allows 
selection of a constant scaling factor which will scale all 
points into nonnegative space. By scaling the data to be 
nonnegative most ambiguity is removed as all intersections 
occuring outside nonnegative space can be rejected, as in 
figure 3.1a. 

To remove any ambiguity caused by both intersections 
occuring within the constrainted pattern space restrictions 
are placed on reference points R^ and R^ . For computational 
simplicity reference point one (R ) is defined as the 

-L 0 

origin. A valid reference point two (I^ ) is defined such 
that one and only one intersection will occur within pattern 
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Figure 3.1a A two dimensional representation of a valid 



reference point two. 




This reference point two is valid for this situation 
in that only one point of intersection lies within 
constrainted pattern space. 
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2 , . 
space . The values of valid reference point twos (R^) are 

generally not hounded and are infinite in number even with 

the uniqueness constraint. The distance from each reference 

point to a point in the pattern space lattice defines the 

radius of a circle. The intersection of the circles about 

each of the reference points defines a point in space. 

Figure 3.1a illustrates the case of a valid R^ and R^ . Note 

that of the two intersections defined by the circles only 

one exist in constrainted pattern space. Figure 3.1b 

demonstrates an invalid R^ in that two points of 

intersection exist in constrainted pattern space. 

The two dimensional pattern space into two dimensional 

distance space transformation may be stated in the following 

manner : 

Given a set of samples Y i = * (* = 1. number of 

samples ) 

in pattern space where 

0 < y j ± + k < (j = 1,2) 

is the maximum value which the 
i th element may assume; 

k is a scale factor such that the 

minimum value of y^ + k > 0; 

2 

From this point forward in the discussion, the term pattern 
space implies a nonnegative, maximally bounded pattern 
space . 
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Figure 3,1b A two dimensional representation of an 
invalid reference point two. 



cons trainted 

pattern 

space 




Ambiguity exists as there are two points of intersection 
defined within constrainted pattern space. 
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x j± * yji + k 

Xj_ = (x li ,x 2i ),(i = 1, number of samples) 

is the set of samples in 
constrainted pattern space 

there exist a set of samples D i = ( d ii* d 2 i.) in distacce 
space obtained through the nonlinear transformation 

T : ( 1 L > Di ) 

where 

dji = CZ r j) 2 t //2 (j =1 ,2 ) , ( i = 1, number of 

samples) is the Euclidean distance 

function as defined above {3.1} 

Ri = (0,0) 

R 2 = ( P i ,P 2 ) is a valid reference point. 

A reference point two is valid for two space if and only if 
there exist one and only one solution within pattern space 
to the simultaneous equations defining (d^) and (d 2 ) for all 
points in pattern space. 

C. TRANSFORMATION FROM THREE DIMENSIONAL PATTERN SPACE 
INTO TWO DIMENSIONAL DISTANCE SPACE 

Observe in figure 3.2 the radii (d lf d 2 ) computed as the 
distance from a reference point to a sample point 
geometrically describe spheres in three dimensions. The 
intersection of the two spheres formed, respectively, of the 
radii d i » d 2 from R-l»R 2 defines a circle in two dimensions. 
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two • 



In continuous space all points on the circle of intersection 
are equally defined by the ordered pair (dj.,d 2 ) in two 
space. To remove this most uncomfortable ambiguity of an 
infinite number of points in pattern space mapping into one 
point in distance space consider the following assumptions : 
assumption 1 pattern space may be represented as a lattice 
of discrete nonnegative, maximally bounded 
points separated by a unit distance; 
assumption 2 the circle described by the intersection of 
the spheres is constructed to contain one and 
only one lattice point; 

assumption 3 a valid reference point two (R 2 ) exist which 
manipulates the circle of intersection such 
that assumption two will be true for all lat- 
tice points in the pattern space defined by 
assumption one. 

Assumption three is logically valid, provided 
assumption one is true, if and only if there exist the 
ordered pairs 



D± = Uijfd 2 i) and Dj = (d X j,d 2 j) for all X it Xj i ^ J 



discrete sample points in three dimensional pattern space 
where 
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{3.2} 



n A (d 2i =d 2 j)] for all D^Dj i * j 

Restating equation 3.2 such that when the following 
equivalent equations are both false for all points X^,Xj (i 
¥■ J) in pattern space R 2 = ( p-|_,p 2 ,p 3 ) ls a valid reference 
point . 



d u 2 - d xj 2 = 0 {3.3} 

d 2i 2 " d 2 j 2 = 0 {3.4} 



Expanding equation 3.4, in considering a three space into 
two space transformation, yields : 






{3.5} 



Squaring and collecting terms results in : 



r li 2 + 1 2i 2 + I 3i 2 ‘ J lj 2 ' *2 j 2 * *3j 2 + Zl lj!>l * Zl 2jP2 + 
2x 3j p 3 - 2x li p 1 - 2x 2i p 2 ” 2l 3 iP 3 = 0 {3.6} 

2 2 2 

Equation 3.1 allows substitution of D li for (x-^ + x 2 ^ + 

2 2 2 2 2 
x 3i ) and “ D ij = (" x ij -x 2j _x 3j ^ and utl li z l n S vector 
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notation for R , x 

2 i 



2's and x 2 ' then 
j 




{3.7} 



Equation 3.7 is the logical complement to equation 2.2 since 
only when the equality holds will a point R 2 = ( P]_»P 2 *P 3 ) 
he invalid. 

Assumption three, that a valid reference point two will 
always exist when assumption one is true, can he proven in 
the following manner. Two sets of constants are present in 
equation 3.7, the differences between the distance ones 
squared and the differences between the data points in 
pattern space for all points (X i , X^ ), (i i- J). Selecting 

3 

the largest difference in magnitude between distance ones 
squared and the minimum difference in magnitude between data 
points (X i ) and (Xj) then a reference point two can easily 
be selected such that the magnitude of the dot product of 
the candidate reference point two and the minimum difference 
between data points (X^ , X^) is always greater than the 
maximum difference in magnitude between distance ones 
squared. Once the minimum reference point two is found then 

3 

The minimum difference in magnitude is that difference 
whose absolute value is closest to the origin. Conversely, 
the maximum difference in magnitude is that difference whose 
absolute value is most distant from the origin. 
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every linear combination of that point is a valid reference 
point. Furthermore, every point larger in value for the 
maximum case and smaller in value for the negative case will 
be valid except for the case Pj_ = Pj = p k in symmetric 
pattern space. 

Consider the example of a three dimensional pattern 
space which is exhaustively defined for all linear 
combinations of integer lattice points in the range of 0 - 
6. The magnitude of the maximum (D-^ 2 - D^ 2 ) is 128. The 
minimum magnitude of the difference (Xj - X^ is the point 
(0,0,1). In accordance with equation 3.7, a reference point 
two is easily found such that 

max magni tude (D 1; j_ 2 - D^ 2 ) < 2 (R^Cmin magnitude(Xj - X^))) 

{3.8} 



For this example, 

108 < 2( R 2 * ( 0,0,1 ) ) 
implies R 2 = (0,0,55) 

In effect, assumption three states there will always 
exist a unique mapping from three space to one space for 
discrete data. 

When equation 3.3 is considered in addition to equation 
3.4 then another degree of freedom is present. The net 
result of this combination is that valid reference point 
twos will exist inside the bounds defined by considering 
equation 3.4 alone. At present valid reference point twos 
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inside the bounds can only be determined by exhaustive 
searches attempting to validate a candidate reference point 
two with equation 3.7. 

D. TRANSFORMATION FROM N DIMENSIONAL PATTERN SPACE INTO M 
DIMENSIONAL DISTANCE SPACE 

Generalizing figure 3.2 into n dimensional space, the 
radius of intersection forms a (n - 1) dimensional 

hypersurface in n space. All the constraints and assumptions 
of the three space transform remain valid for the n 
dimensional case. The derivation in the previous section 
that a valid reference point two always exist in three space 
is but one case of the n dimensional argument. To extend the 
proof to n space simply increase the indices of the vectors 
to the desired value of n. There is no difficulty in mapping 
a (n -1) dimensional hypersphere defined by the radius of 
intersection of m spheres into a single, unique point in m 
space where m ranges from one to infinity. 

The n dimensional transformation may be stated as : 

Given a set of sample data points Y i = (y lif y 2i . • • ,y ni ) ’ ^ 1 = 
1, number of samples) in pattern space where there exists a 

set of points X ^ 2i’ * * * ni^ ’ ^ = ^* nU[T1ter 

samples) where X^ is constrainted to be 

1. nonnegative ^ji + ^ 0 

x :i = * k 
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2. maximally bounded x ji^- a i 

3. a member of the set of lattice x..£{P} 

ji v 

points with a unit separation P = {all lattice 

between points points} 

k is a constant scale factor such that all possible 
points in data space are nonnegative values 
a ^ is the maximum value a (x^) may assume 
there exist a set of sample points D i = (d ii» 4 2i’ * * mi^ 1-11 



distance space 
where 

d b i= CS(x ji -R b ) 2 f /2 (b = 1 ,m) is the Euclidean 





distance 




R i = (0,0 0 ) 






R b = (P lb»? 2b’ • • * nb> 


(b = 2,m) are defined by 






equation 3.2 




While it has not 


been proven formally, the 


allowable 


unit separation between 


points is hypothesized 


to be 


minimally bounded on 


the numerical precision 


of the 


discretization process 


employed to transform 


physical 



embodiment into machine representation. 

E. SUMMARY 

A powerful nonlinear transformation has been developed 
which provides a one-to-one mapping from n space to m space, 
where typically (m<<n). The effects of this transform on the 
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information content ana cluster formation in the 
representation are presented in the following chapters. 
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IV. TRANSFORMATION EFFECTS ON CLUSTERING 



The number of valid reference ooints (R, ) has been shown 

b 

to be infinite. Implicit in this fact is the choice of 
transformations is also infinite. Given this infinite 
selection of transformations the objective is to determine 
the transform which provides the greatest degree of class 
clustering and interclass separation. Measures of 
improvement are discussed as a means to accomplish this 
objective. 

The conversion of pattern space into distance space is 
presented geometrically to provide some insight into the 
transformation process. 

A. GEOMETRIC INTERPRETATION OF CLUSTER FORMATION 

IN DISTANCE SPACE 

The unique mapping from n space to two space is a 
function of the (n - 1) space tangent hypersphere generated 
by the intersection of the radii d ,d . Reca11 from figure 
3.2 that the "direction" in which the tangent surface slices 
through data space, the range of values for the curvature of 
the surface of the tangential hypersurface over pattern 
space and class sample point dispersion relative to that 
"direction" shape the clustering and class separation which 
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occurs . 



The change in curvature of the surface of the tangential 
hypersphere is locally minimal hut over the entire range of 
the data space may he quite extreme, depending on the value 
of reference point two. Points in relatively close proximity 
will have approximately the same tangential curvature 
(figure 4.1a). Points which are relatively distant and 
clustered perpendicular to the tangent line will experience 
a greater change in curvature between the points (figure 
4.1b). Points relatively distant hut having nearly the same 
tangent curve will map in close proximity in two dimensional 
distance space (figure 4.1c). Points in relative proximity 
to each other, in the sense their tangent curves are in 
relative proximity, become more tightly clustered in 
distance space. The physical reality of this fact is that 
the points in relative proximity to one another are nearly 
equal in distance to reference point two. 

The concept of relative proximity does not allow total 
deinterleaving of sample points of different classes. 
However, any class separation which does exist in any one or 
more dimensions in pattern space can he enhanced in distance 
space with the correct choice of reference point two. This 
enhancement is especially noticahle when distance squared 
instead of distance is utilized to determine an element of 
the m space vector since distance squared emphasizes the 
maximum differences between elements of the vectors ( X i - 
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Figure 4.1a Similar tangent 




arcs passing through a cluster. 



Figure 4.1b Variance in 
curvature 

The curvature of the tangent 
arcs slicing through cluster A 
is greater than that of the arcs 
passing through cluster B. 





Figure 4.1c Mapping effects on 
different classes with similar 
tangent arcs . 
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B. MEASURES OF INFORMATION CONTEXT 



One criterion for det ermini ng the degree of class 
clustering and interclass separation is to compare the 
intraclass variability to the interclass variability. Duda 
and Hart [l] measure this variability in terms of the 
scatter within classes (S 77 ) and the scatter between classes 
(S n ). Their technique will be utilized in computing a 

JD 

information context measure (I ), the ratio of (S T7 /S_) it q 

(J Wo 

dimensional space. This ratio is computed in the following 
manner. ' 

A q dimensional sample mean vector for class i is computed 
as 



M. = 2 X {4.1} 

11^ 

x€x ± 

where 

M . is the mean vector for class i 
i 

w.^ is the number of samples in class i 

Xi is a member of the set of samples in class i 

The within class scatter (S T7 ) is the sum of the within class 

w 

scatter for each class. The within class scatter is 



calculated as the distance squared from a class mean to all 
points in that class. 




-I, K i> <*r M i )T 

1=1 i=l 



{ 4 . 2 } 



where 

c is the number of classes 

i is the class index 

<X ± - M^ls the transpose of ( I ^ - M i ) 

To calculate the scatter between classes (S B ), the total 
mean for all classes must be determined. 

1 c 

Mm= Z ^ w 'M : {4.3} 

i-1 

where 

w. is the number of points in class i 
is the mean vector for class i 
z is the sum of for all classes 
Then the scatter between classes (S B ) is 

C T 

S B = r M T^ K t ) { 4 . 4 } 



The scatter within decreases as class clustering is 
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improved. The scatter between increases as interclass 
separation increases. The ratio (I a ) is computed to measure 
the interaction of those two facts. Minimizing this ratio 
when transforming the data samples from pattern space to 
distance space is a measure of improvement contributed by 
the transformation. The term miminize is used in a relative 
sense. The ratio (Iq) will approach zero as the separation 
between classes increases to infinity or the intraclass 
scatter decreases to zero. Generally that degree of 
separation will not be required. By providing a 
geometrically comprehensiabl e representation of n space data 
in one, two, or three dimensions the user may be able to 
discern a separation which is sufficient without a minimal 
(I q ) ratio. 

The ( Iq ) measure, when computed as (S W /S B ) is, in the 
case of unimodal class distributions, the sum of squared 
error criterion. For multimodal class distributions and 
other complex class distributions other optimality measures 
will be more appropriate. Multimodal class distribution 
difficulties can sometimes be overcome by redefining 
multimodal classes into separate classes and applying the 
(I q ) measure. More complex problems such as dense clusters 
inside a diffused cluster, for example a sphere within a 
sphere or interlocking tori, will require different 
information measuring criteria. These measures are typically 
application dependent. An example of a three dimensional 
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cube within a cube is presented as a study of utilitizing 
the (Ig) measure on complex problems in the following 
chapter . 

C. TRANSFORMATION EFFECTS OF ALTERNATIVE REFERENCE POINTS 

The effect of passing the intersection of the two 
hyperspheres through a pattern space might best be realized 
in examining a geometrically conceivable example. Consider a 
three dimensional set of integer points bounded on the 
interval (0 - 6 ). This data set is known to contain two 
classes separated by the plane x = y. The points x = y are 
members of neither known class. Figure 4.2 illustrates this 
example. The ( 1 3 ) ratio in three space for this data set was 
computed to be 1.699991. An arbitrarily selected reference 
point two R 2 = (18,21,-1) yielded a ( I 2 ) = 80.819992. As 
shown in figure 4.3a this reference point generates a poor 
mapping solution in terms of clustering since points from 
distinctly separated classes map adjacent to one another. 
Note in figure 4 . 3 b that the poor solution was the result of 
a reference point two which forced the tangential surface 
direction to have relative proximity across classes. A 
better choice of R 2 would force the intersection to be 
nearly parallel to the known class separation. Figure 4.4a 
shows the results of more carefully selected R 2 = 
(-999,999,1). Here the (I 2 ) ratio in two space was .200012. 
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Figure 4.2 A bisected cube 
I 3 = 1.699991 
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Figure 4.3a A poor mapping solution to the bisected cube 



Figure 4.3b A mapping solution 
which forces the tangent curves 
across clusters. 
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• DISTANCE*x2 FROM REF. PT. 




0ISTPNCE**2 FROM ORIGIN 



I 3 = 1.699991 

I 2 = .200012 



Figure 4.4a A nearly optimalmapping solution 



Figure 4.4b A mapping 
solution which separates 
classes and enhances class 
clustering. 
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Figure 4.4b is a presentation of this data in two 
dimensional distance space. This point enhanced the 

separation to the extent that the means are spread must 
further apart. The separation between classes has been 
enhanced . 

An iterative processing technique must be utilized when 
class separation is not readily apparent. In most cases, 
varying the value of reference point two toward a minimum 
(Iq) proved highly successful in finding a good two 

dimensional representation. The term good implies 

sufficient. A sufficient ratio must be user defined. Figure 
4.4c is a transformation of the example utilizing R 2 = 
(40,1,6) to yield a (I 2 ) = .748836. This ratio is not 
minimal but certainly can be preceived as sufficiently 
separating the classes. 



D. SUMMARY 

The location of reference points determine the 
information context of the distance space representation. 
When the distribution of classes within pattern space is 
unknown, an iterative technique based on some optimization 
criterion can be utilized to locate reference points which 
provide sufficient transformations. 
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4.4c A sufficient ratio transformation 
I 3 = 1.699991 I 2 = .748836 
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V. EVALUATION PROCEDURE 



Two different experimental procedures were employed in 
evaluating the performance of this dimensionality reduction 
technique. In developing this procedure the initial method 
was to locate a valid reference point (R) before performing 
a transformation. This was done to ensure the transformation 
provided a unique mapping. After deriving an analytical 
method of partially bounding the locations of valid 
reference points this method was reversed. The search for a 
sufficient transformation was conducted and, if required, 
followed by a validation of the reference point. The 
validation procedure will be discussed followed by the 
sufficient transformation search procedures. 

A. REFERENCE POINT VALIDATION 

Assumption three of section 3C states a reference point 
(R) exists which will manipulate a circle of intersection 
such that assumption two of that section will be true for 
all lattice points in the pattern space defined Dy 
assumption one. Without a closed form analyical derivation 
for validating reference points the only way to validate a 
reference point was to transform the data into distance 
space and verify a unique mapping existed. Confirmation 
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required an exhaustive comparison of each data point with 

every other data point to prove a unique mapping. 

The computational complexity involved in performing 

referance point validation increased exponentially as the 

number of dimensions in pattern space increased linearly. 

This was as expected by the "curse of dimensionality". 

The SEARCHR2 computer program contained in this thesis 

is an implementation of equation 3.7. This algorithm 

computes the two sets of constant differences . (D,. 2 - D., 2 ) 

li lu 

and (x . - x.), and stores them in array data structures. The 
D i 

alternative method of implementing the algorithm would be to 
forego the arrays and compute each difference as it is 
requi red . 

The first method, computing and storing the differences, 

is computationally more efficient in terms of execution time 

when more than one candidate reference point is to be 

verified. This is because the difference matrices need be 

computed only once. The tradeoff for execution speed is 

memory storage. The memory requirements increase 

exponentially as the number of dimensions. The memory 

requirements can be decreased to some extent by requiring a 

symmetric pattern space. The differences of (x . - x .) is the 

D i 

negative of (x.-x.). This implies only (n * (n - 1)) / 2 

i : 

differences in lieu of (n ) differences for each of the two 
types of differences computed. Table 5.1 vividly 
demonstrates the "curse of dimensionality" and its effects 
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on memory storage required, for various pattern space 
configurations . 

Table 5.1 Memory requirements of program SEARCHR2 for 
various pattern space configurations. 



DIMENSIONS 


RANGE 


NUMBER OE 


TOTAL MEMORY REQUIRED 






LATTICE 


FOR BOTH ARRAYS 






POINTS 


(BYTES) 


1 


0-5 


6 


120 


2 


0-5 


36 


5670 


o 


0-5 


216 


301860 


4 


0-5 


1296 


14265720 



In this table, memory requirements for the difference arrays 
are based on the "FORTRAN G programming language as 
implementated on an IBM 360/67. Single precision, four byte 
numerical representation is assumed. 

The memory allocation requirements can be overcome by 
computing the (n * (n 1)) / 2 differences as they are 
required within the program flow. However the execution time 
will dramatically increase as the pattern space 
configuration increases in dimension. Only by optimizing to 
the greatest extent possible might an acceptable program 
execution time be generated. 



The need for this algorithm has been obviated to some 



degree "by the development of an analytical derivation of a 
minumim bound on reference points. This algorithm Is still 
required when validating points inside the minimum bound as 
noted in section 3C . 

An alternative to circumvent both of these problems 
would be to evaluate a reference point only over the set of 
known data samples rather than an exhaustive pattern space. 
This technique would cure the curse of dimensionality but 
would not guarantee assumption three for all points in 
pattern space. This concept might be suitable in low noise 
si tuati ons . 

This possibility brings to light the consideration that 
a unique mapping may not necessarily 'be required. Vhat would 
be desirable, but much more difficult to define, is a 
transformation which does not permit samples from different 
classes to map into the same feature space point. 



B. TRANSFORMATION EVALUATION 



The study of transformation effects progressed from 
simple synthetically derived cases in two and three 
dimensions into complex real data in 10 and 32 dimensions. 
All cases were mapped into two dimensional distance space. 
Research was first performed in geometrically conceivable 
spaces in an attempt to gain the greatest amount of insight. 
All studies were performed on an IBM 360/67. Transformation 
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numerical results were produced as well as two dimensional 
Versatec plots of the resulting distance space 
representations . 

In performing the various case studies the evaluation 
objectives were to : 

1. gain an understanding of transformation effects? 

2. confirm that the (I ) ratio provided a valid measure of 

q 

transformation performance? 

3. determine methods of locating reference points which 
provide a sufficient transformation? 

4. show that real data can be successfully transformed 
into a lower dimensional representation and still retain 
information context. 

Some insight gained in pursuing objective one has been 
detailed in chapter IV. Further illustrations will be 
provided in the following chapter. The chapter on results 
will document the usefulness of the (I q ) ratio and 
acknowledge some of its weaknesses. 

The methods of locating sufficient reference points were 
constantly being refined in processing the various case 
studies. Initially it was thought that the optimium 
reference points would exist only along an axis. This is 
most definitely not true. The search procedure evolved into 
an iterative processing method. This method rated various 
reference points solely on their resulting ( I q ) value. The 
procedure was to minimize the (I q ) ratio since the smaller 
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in value 



( I g) , the more information context present in the 
feature space representation. The maximum value of the 
magnitude of the reference vector is unbounded. To limit the 
search region the user arbitrarily selected a maximum bound 
magnitude. Utilizing either the positive or negative bound, 
a single component of the reference vector was varied by 
some interval to the opposite bound while holding all other 
components of the reference vector constant. This allowed 
the user to observe effects of various values of this vector 
component. The effects were judged by comparing the various 
values of (I_) generated. The minimum (I ) was selected and 

q q 

the procedure started again with a smaller interval centered 
around the component value which generated the minimal (I ). 
This procedure was continued until a minimal (I ) ratio had 

q 

been reached with that component. The process was repeated 
for each component in the reference vector. 

For simple cases of three or four dimensions 
combinations of two or three minimal component values were 
tested with all other values held constant. This test 
occasionaly provided useful results but was not consistent. 
After each component of the reference vector had been tested 
individually, all minimal (I ) producing components were 

Si 

combined together and tested. For all test cases, this 
procedure always yielded the lowest (I ) measure. When all 
( Iq ) measures were compared against their plots the minimum 
(Iq) always had the ’’best" appearing plot in ter-s of class 
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clustering and class separation 



As of this report this iterative processing procedure is 
the methodology recommended. However, this procedure is not 



wi thout 


faults. The test 


and evaluation 


procedure 


requires 


testing 


each component 


of the n di 


mensi onal 


reference 


vector . 


This is a minor 


bother in low 


d imensi on 


pattern 


spaces 


but becomes quite 


awkward in high 


dimensional spaces. 



The 32 space reference vector would have required 34 
computer runs to claim a satisfactory search for a 
sufficient reference point. Secondly, it was discovered, not 
unexpectedly, that local minima of (I ) exist within the 
hounded set of possible' reference points. At oresent there 
is no closed form solution for finding the optimal reference 
point. The only way to overcome problems of local minima is 
extensive testing. Thirdly, if a sufficient reference point 
is found to exist below the minimum boundary for reference 
point two, the SEARCHR2 program will be required to validate 
the reference point. This complicates the situation even 
further with all the limitations of that program. 

C. Implementation tradeoffs 

This technique provides the researcher or engineer a 
choice of alternatives. One alterative will require a 
certain amount of not inconsequential time and effort to 
find a reference point or points to provide a sufficient 
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distance space representation. But the fruit of that effort 
will he the ability to oerform the remaining portions of 
testing and training in distance space. Significant here is 
that the time consuming portion of the effort is devoted to 
the training phase. This is typically not the phase which is 
time critical. The distance space representations are less 
computationally complex. Hence, the testing phase will 
benefit from the reduced complexity with decreased execution 

i 

times. This will be especially useful in real time decision 
making applications where the testing phase is time 
cri tical . 

The second alternative is to forego the time comsuring 
effort in training but with a commensurate increase in 
computational complexity in the testing phase. 

The researcher or engineer must judge which is the most 
cost effective for his application. The following chapter 
will hopefully provide some insight into what is required if 
the first alternative is selected. 
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VI. EVALUATION RESULTS 



In evaluating the transformation seven test cases were 
studied. The evaluation proceeded from simple three soace 
problems to a complex 32 dimensional real data problem. 
Discussion of each case comments on how the data samples 
were derived, the procedures in evaluating the case studied, 
and the results. Graphic illustrations are provided as 
appropriate. The appendices contain complete documentation 
on the progression of testing for all cases studied. 

A. CASE 1 : A THREE CLASS THREE SPACE PROBLEM 

A simple problem was first attempted to gain insight 
into the transformation process. Figure 6.1a illustrates the 
heuri stically derived points in pattern space. Appendix A 
contains a listing of the points which make up each class. 
The transformation was from three space to two space. In 
three space (I^) = .2319393. The best (I^) rat i° achieved, 
in a less than exhaustive search, was 0.07986128. 

Various linear combinations of reference point twos (R 2 ) 
were tested to observe the transformation effects on pattern 
space. The distance space representations were plotted with 
the X axis as distance to the origin sauared and the Y axis 
as distance to R 2 squared. It is interesting to note in 
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Figure 6.1a A three class three space problem 



I 3 = 0.231939 




class 1 ( 1,2, 3, 4 ) 

class 2 ( 5,6 ) 

class 3 ( 7,8,9,10 ) 
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figures 6.2b - f the results developed utilizing 

linear combinations of an R 2 point. Observe t 
relative proximity of the classes is unchanged w 
relative positions within the classes are a function 
reference point two utilized in the transformation, 
to be generally expected as the within classes relat 
will change as the reference point two changes. This 
a function of the fact that the distance to the orig 
changes while the (d 2 ) values vary as the (R 2 ) vary. 

This last observation suggest an examination of 
reference point one from the origin in an attempt to 
class separation. While it may be a valid con 
transformation becomes much more complex in the 
This examination is suggested as a topic for 
research . 



va ri ous 
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ionships 
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B. CASE 2 : A THREE DIMENSIONAL BISECTED CUBE 



A three dimensional cube of integer lattice 
developed for this study. This case was 
discussed as the geometrically conceivable 
section IV C. Figure 4.2 illustrated the 
configuration of the classes. 

This case has some interesting complications 
space the (I 3 ) ratio is 1.699991. The class mean 



points was 
pre vi ousi ly 
example in 
three space 

. In pattern 
s are : 
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.096678 

(- 1 , 1 , 6 ) 



.094691 

( 6 , 1 , - 1 ) 




Figure 6.1b 




4 



1 2 ,5 7 

6 9 



Figure 6.1c 





.212315 

(- 1 , 21 , 8 ) 




Figure 6.1e I_ = .080043 
1*2 = ( 6 , - 1 , 1 ) 




Variations in within class relationships as R 2 changes 



I 3 = 0.231939 
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class 1 



( i , y * z ) 

( 1.66, 3.33, 1.5 ) 
class 2 ( 3.33, 1.66, 1.5 ). 

The scatter within classes (S w ) are equal. An (1^) ratio 
greater than one implies the distance between the two class 
means is less than the average distance between a class mean 
and the samples within that class. Even with the (I g ) ratio 
greater than one there exists a distinct linear separating 
boundary between the classes. 

Appendix B contains a listing of the data points in each 
class and a summary of the iterative processing steps for 
this case. Ten iterations were required to achieve an 
"optimal" value. As noted in chapter IV a sufficient 
solution was obtained on the fourth iteration. This 
demonstrates the value of having a two dimensional picture 
of the data on which to make judgements about that data. 

It occured to this researcher, upon examining the 
results of iterations six and seven (see appendix 3), that 
the minumum value was symmetric in magnitude in the X and T 
components. Iterations 7-12 attempted to exploit this fact 
by testing beyond the user defined bound of 999 in the X and 
T components of the vector. This proved quite successful as 
figure 4.3a illustrated. By symmetrically increasing the 



values of the 


X and T 


components 


the 


(I 2 


) ratio was 


minimized. As 


reference 


point two 


is i 


moved 


further from 


pattern soace 


the change 


in curvature 


of 


the tangent 
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intersection becomes almost nil. This occurs because tne 
circle of intersection begins to approximate the surface of 
the sphere defined by the (d 2 ) distance as shown in figure 
6.2. In effect, this forces similar points to map almost 
linearly into distance space. This fact accounts for the 
apparent subclusters that exist in each of the classes. 

In step seven, the Z components were varied to study 
their effect on the (I 2 ) ratio. As can be seen from the data 
increasing Z in magnitude above one adversely affected the 
( I 2 ) ratio. In iterations 9, 13, and 11 note that symmetric 
points in the X,Y plane yield similar, if not equal, 
results. This can be explained by realizing that the 
"direction" of the circle of intersection of the various 
symmetric points and reference point one are very nearly 
equal. They differ in that the F 2 sphere is located on the 
opposite side of the sphere. 

This case study proved the most enlighting as to the 
geometric effects of passing the intersection of the spheres 
through pattern space. 

C. CASE 3 : A CUBE WITHIN A CUBE 

This case was selected to study the effectiveness of 
using the (I a ) measure in a complex problem. Two cubes were 
generated in a three dimensional pattern space containing 
integer lattice points in the range (3,3,0) to (5,5,5), 
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Figure 6 . 2 



Change in curvature of the tangent intersection 
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Appendix C contains a complete listing of the data. The 
outer cube exhaustively surrounded the inner cube. The inner 
cube mean was (3.0 ,3.0, 2.5) . The outer cube mean value was 
(2.84,2.84,2.5). Thus the outer cube mean value was 
contained inside the inner cube. The three space (1 3 ) ratio 
was 2950.249. The "optimal" (I 3 ) ratio was 66.218964. Figure 
6.3a is the resulting two space representation. The 
reference point two which yielded this result was ( 6 , 1 ,- 1 ). 
A listing of all points tested is contained in appendix C. 

A more visually appealing result is illustrated in 
figure 6.3b. Generated from R 2 equals (360,-60,1), the (I 2 ) 
ratio was 2574.547. The points are bunched into six 
clusters. Each group of points can be characterizd by its 
location on the Z axis in the three space representation. 
For example, the group located nearest the X axis in the two 
space representation is all the points located on the Z = 0 
plane in three space. 

This example provides some insight on how the 
transformation skews pattern space into distance space. In 
this three space to two space example, the perspective is 
changed much like an artist would skew an image to provide a 
three dimensional perspective on a two dimensional canvas. 
This suggest there may be some applications for this 
transformation in the field of computer graphics. 
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6.3a A two dimensional distance space representation 
of a three dimensional cube within a cube. 

I 3 = 2950.249 I 2 = 66.218964 
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Figure 6.3b A visually interpretable two 



space representation of a three space cube 
within a cube. 
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D. CASE 4 : THREE SPACE SERIES OF CONVERGING CLASSES 

This study was a series of five cases in three 
dimensional space in a lattice containing all integer points 
from (0,0,0) to (24,24,24). The cases differ by the relative 
location of the two classes in space. The data points for 
the two classes were generated on a Texas Instruments TI-59 
calculator using the random number generator program 
(ML-15). The class one seed was 2135. The class two seed was 
7540. The standard deviation used was 2.0. These parameters 
were kept constant across the experiment so that the only 
parameters of variability were the distance between classes 
and reference point two. Table 6.2 contains the mean samples 
generated for each class. 



Table 6.2 


Sample 


means 


for three 


space series of 


convergi ng 




classes 










case 


class 


1 mean 






class 2 mean 




X 


y 


2 




x y 


z 


1 ( 


4.25, 


3.41, 


3.08 ) 


( 


20.16, 19.67, 


19.58 ) 


2 ( 


6.08, 


5.41, 


5.08 ) 


( 


18.33, 18.50, 


17.66 ) 


3 ( 


8.00, 


7.50, 


7.09 ) 


( 


16.33, 16.50, 


15.67 ) 


4 ( 


9.16, 


9.41, 


9.08 ) 


( 


14.33, 14.50, 


13.66 ) 


5 ( 


12.08, 


11.41, 


11.08 ) 


( 


12.33, 12.50, 


11.67 ) 


This 


study 


was two fold 


in 


purpose. One 


goal was to 


observe the effects on 


selec ti on 


of R 2 as the classes 
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approached one another. Secondly, an attempt was made to 
distinguish where the transformation would not longer 
separate classes. 

As before all cases were processed using the systematic 
iteration procedure delineated in the previous chapter. The 
following results were obtained. 



Table 


6.3 I 


q results 


for three space converging 


classes 


case 


I 3 


1 2 


ref ere 


nee point 


iterations figure 


1 


0.061068 


0.014587 


( 66 , 


66 , 66 ) 


5 


6 .4a 


2 


0.106720 


0.027066 


( 63, 


63, 63 ) 


4 


6 .4b 


3 


0.238156 


0.47232 


(-99, 


-540,-99) 


5 


6.4c 


4 


0.813121 


0.153407 


(-99, 


-540,-99) 


4 


6.4d 


5 


32.466873 


4.560885 


(-150, 


-900,-150) 


3 


6.4e 



Cases one and two share similar reference points as do 
cases three and four. Unfortunately, there is not enough 
samples here to rationalize why this is so. Since the 
classes vary between cases only by their separation then it 
will said that the relative proximity between classes does 
affect the choice of R 2 » In case five, the classes shared 
the same mean. They were highly interleaved as shown by the 
I 3 ratio of 32.466873. The change in the I 2 ratio is a 
measure of how much deinterleaving took place in the 
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transformation. Case five further supports the premise that 
the relative proximity of the three space data was 
maintained in that total deinterleaving did not occur. This 
technique claims to only enhance separation present in 
pattern space in the distance space representations. To 
further comment on the behavior of R 2 will require a more 
exhaustive examination of its performance under similar 
si tuati ons . 

E. CASE 5 : TEN SPACE SERIES OF CONVERGING CLASSES 

This study is a series of four cases. Pattern space is a 
tec dimensional integer lattice containing all points from 
the origin to (19,19,19,19,19,19,19,19,19,19). Two classes 
were generated in each case. The samples were synthetically 
derived using the IBM 360/67 and utility program LLRANBCM 
entry point NORMAL. The seeds were held constant for each 
class over all four cases. The variance selected was 2.0. 
The following means were generated for each of the classes. 
Read a class mean vector as a column in the table. 

Table 6.4 Sample means for ten space series of converging 
classes 

case 1 2 3 4 

class 12 12 12 12 

4.12 15.43 5.12 14.56 e .62 12.06 9.81 10.06 



75 



3.18 


15.68 


6.00 


15.12 


8.43 


12.62 


9.75 


10 .06 


4.06 


15.43 


5.50 


13.31 


8.06 


12.43 


10.31 


10.06 


4.56 


16.50 


6.18 


14.06 


8.06 


12.43 


10.31 


10.06 


2.93 


15.93 


6.73 


14.56 


8.06 


11.93 


9.93 


9 .78 


4.50 


15.37 


5.75 


14.06 


8.12 


12.31 


10.31 


9.87 


4.25 


16.18 


5.81 


14.25 


8.62 


12.18 


10.37 


9.12 


3.81 


16.37 


5.62 


13.50 


8.06 


12.00 


9.93 


9.06 


3.75 


17.00 


6.18 


13.81 


7.56 


11.62 


9.62 


9.18 


4.00 


16.12 


6.43 


14.37 


8.00 


12.37 


10.16 


9 .75 


goals 


of this 


study 


are 


similar 


to 


the previous 



study in three dimensions? to observe the behavior of a s 
the classes approached one another and to atterrct to 
distinguish when the transformation would no longer separate 
classes. The results obtained are detailed in table 6.5. 



Table 6.5 



Iq results for ten space converging classes 



case 


*10 


l 2 


iteration 


figure 


1 


0.069465 


0.004561 


1 


6. 5a 


2 


0.158126 


0.023578 


1 


6.5b 


3 


0.594771 


0.062027 


1 


6.5c 


4 


36.600388 


8.294548 


8 


6. 5d 



The I results were obtained with the following reference 
9 

points: 
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Table 6.6 Sufficient reference points for ten space 
converging classes 

reference point two 

( 51, 52, 53, 54, 55, 56, 57, 58, 59, 60) 
(-501 ,-502,-503,-504,-505,-506,-507,-508,-509,-510) 
(-501 ,-502,-503,-504,-505 ,-506,-507,-508,-509,-510) 

( 999, 800,-821,-219,-111, 900,-999,-411,-511,-611) 

In observing that only one iteration was required to 
find a sufficient separation, it can be said that the 
inherent separation in the data allowed a wide choice cf H 2 
to provide a sufficient transformation. It is interesting to 
note that cases two and three utilized the same reference 
point. This is the same occurance as with the three space 
study. In both studies the reference points for the 
noninterleaved cases were not near the sufficient solution 
reference points for the interleaved cases. 

The transformation had no problem maintaining or 
enhancing the inherent separation in the data. Only in the 
overlapping case was an I 2 <1 not achieved. However, a 
significant reduction in the I ratio was achieved in all 
cases . 

In the fourth case of this study the adminstrative 
complexity of high dimensional data became a burden. To 
allow sampling over all elements of the R 2 vector ten 



case 

1 

2 

3 

4 
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iterations should he required. In the evaluation only eight 
were performed as modifying the individual components of the 
reference vector became unwieldy. The burden could be 
essentially overcome with a more automated test procedure at 
the cost of more computer execution time. 

G. CASE 6 : TEN SPACE THREE SHI? RADAR TARGET RECOGNITION 
DATA 

This study was conducted to observe the performance cf 
the transformation on real data in high dimensions. 

The data was collected by the Naval Weapons Center, 
China Lake, California as part of a research effort on radar 
ship classification techniques. The samples consisted of 
radar profiles of selected ships. The samples experienced 
some preprocessing prior to being input to the 
dimensionality reduction technique. The received radar 
echoes were taken from the radar receiver and fed through an 
analog-to-digital converter and eventually stored on 
magnetic tape. The remaining preprocessing is shown in 
figure 6.6. 

The samples were gathered in 512 dimensional space. For 
the purposes of this study only the first ten components of 
each sample were utilized. When received from NWC the 
samples ranged in value from -8.0 to 1.0. To meet the 
assumption that the data exist in a lattice pattern space it 
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Figure 6.6 Preprocessing flowchart 




PATTERN CLASSIFIER 



83 



was scaled Into an integer space ranging from 0 to 300 in 
each component. Each real number component was scaled with 
the followine procedure : 

1. add 8.0 

2. multiple by 32.0 

3. add 0.5 

4. truncate the fractional part. 

Appendix F contains the resulting samples and the iterative 
processing results. In the first case of this study each 
class contained 16 samples. 

The ten space data had a (I 10 ) ratio of 3.750768. The 
sufficient ( I 2 ) ratio was .189089 when processing ceased. 
Twelve iterations were required to achieve this result. 
Figure 6.7a is the two space result of the transformation. 

The iterative processing technique proved effective. 
After identifying the "best" value for each component of the 
reference vector in iterations 1 - 11, the "best" value for 
each component was placed into a single vector. This step 
yielded a result of 0.442269 and figure 6.7b. In examining 
each of the components of the mean sample for each of the 
classes it was observed that the components with the most 
variability between classes developed I q minimizing 
reference point components which were not near the user 
defined bounds of plus or minus (9999, 9999, ... ,9999 ) . In 
this study components one, two, and three of the sample mean 
vectors exhibited this behavior. The remaining components 
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had niminal variation of mean component values between 
classes. The remaining components generated reference point 
two component values at the user defined hounds, -999S or 
9999. 



In malting these observations it was decided that the 
’’best" value for those components with values at the bound 



had not reached the minimum ( I 2 ) for that element. These 
particular values were increased by a factor of ten and 
tested again. This was the vector which generated the 
minimum ( I 2 ) . This behavior is similar to that documented 
for the X and Y components of the bisected cube problem. 

After determining the reference point two which yielded 
the lowest (I 2 ) over the 48 sample set it was decided to 
test the entire set of training samples. The training 
samples consisted of 423 samples divided into three classes. 
Class one contained 141 samples. Class two consisted of 137 
samples. Class three had 145 samples. Two reference points 
were- tested. The first was the value determined for the 49 
sample set. The second point was similar to the first but 
with the negative -9999 components increased by a factor of 
ten. The following results were obtained. 



Table 6.7 Ten space ship profiles reference points 

reference point I 2 figure 

(-3000,-4500,-7000,-9999,-9999, 1.57816? 6.7c 

99999,99999,99999,99999,99999) 
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Figure 6.7c Ten space ship data 423 samples 
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( -3000 , -4500 , -7000 , -99999 , -99999 , 

99999,99999,99999,99999,99999) 1.310979 6.7d 

Figure 6.7e is an enlargement of the heavily clustered area 
of figure 6.7c. While there is a large amount of noise 
present, as would be expected in real data, the claim will 
be made that three distinct clusters of data exist, one for 
each class of ship. Figure 6.7f is an enlargement of fisrure 
6.7d. The same claim regarding clustering is made for this 
representation also. 

G. CASE 7 : 32 SPACE THREE SHIP RADAR TARGET RECOGNITION 
DATA 

This study is a continuation of the previous study in a 
higher dimension space. The same ship profiles were utilized 
with 32 components per sample instead of ten. The samples 
were scaled in the same manner as the ten space samples. 
Appendix G contains the references points tested in the 
iterative processing and the sample means for each of the 
classes. The samples are not listed due to their large 
number. 

The two space representation of 32 dimensional samples 
in figure 6.8 exhibits much similarity to the ten space 
representation in figure 6.7c. The general location of the 
three ship classes is unchanged between the two figures. The 
reference point which generated the 0.189087 (I 2 ) ratio for 
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the ten space study was utilized as the first ten components 
of the 32 space vector. Sixteen iterations were required to 
test the first 24 components of the reference vector. The 
minimum (I2) ratio obtained was 1.624708. The 32 space (I32) 
was 3.607182. The similarity between the 32 and 10 space 
representations is as much as result of the data as the 
transformation. A discussion of the data and its meaning is 
beyond the scope of this thesis. The claim is again made 
that the two space representation contains three distinct 
clusters, one per ship. 



H. CASE STUDIES SUMMARY 



A series of seven cases have been tested. The studies 
highlight various effects found in the transformation 
process. The simple three class three space problem 
illustrated the changing relationship of data within classes 
when R-^ is fixed at the origin and R 2 is moved around. The 
bisected cube provided insight into how the curve of 
intersection passed through pattern space. It further 
demonstrated geometrically how the curve of intersection 
should cross pattern space to achieve the greatest amount of 
class clustering. The cube within a cube example was 
utilized to study the use of the (I q ) measure in a complex 
problem. The (I ) ratio was shown to yield good results when 

mi 

used as an optimization criterion. However, it was also 
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shown that when different goals are desired (graphical 
display) (I ) may not be the best method of achieving that 



objective. The three and ten space converging class studies 
demonstrated that as long as some separation existed between 
classes that separation could be enhanced in the lower 
dimensional representation. They further illustrated that 
the transformation will not remove class interleaving 
inherent in pattern space representations. Stated 
differently, the general relationships which exist in 



pattern space 


will be 


retained in the dist 


ance 


space 


representation. 


These 


two 


cases demonstrated 


that 


the 


t ransf ormati on 


process 


can 


function effectively 


in a 


noi sy 



environment . 
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VII. CONCLUSIONS 



A nonlinear transf ormation has been developed which 
retains or improves relative proximity of similar 
information while significantly reducing the representations 
of data for several specific cases. These studies have shown 
the feasibility of this technique. They support the 
supposition that this transformation is a valid process 
suitable for general applications of dimensionality 
reduction . 

The concept of information context is valid. 3y 
representing in m dimensional space the relative 
relationships of data in n dimensional space, rather than 
the data itself, there is essentially no loss of contextual 
information in the lower dimensional representation. 

A. RECOMMENDATIONS FOR CONTINUED RESEARCH 

1. First and foremost is testing the reduced 
representations in a pattern classification algorithm. To 
truly Judge this an effective technique the pattern 
classification results must yield equal or better results 
than the classification results obtained with the n 
dimensional data. 

2. Development of a better method of efficiently and 
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rapidly locating "optimal" reference points is critically 
needed. The current methods will become unworkable as higher 
dimension spaces are tested. The method could be some closed 
form analytically derivable result or an iterative search 
computational method. 

3. High dimensions should be explored to observe any 
effects which may present themselves. 

4. The minimum bound on the lattice point interval 
should be determined. This researcher feels it will be the 
smallest interval which will still uniquely represent 
information at the desired level of accuracy. As an example 
for single precision FORTRAN on the IBM 360 (7.5 digits 
accuracy) if the interval is 0.0001 then all points in 
pattern space must be capable of being uniquely represented 
within the remaining 3.5 digits of accuracy. A second bound 
on the lattice interval will be the discretization process. 
If an analog-to-digital converter collects eight bits of 
information then those bits define the information cells of 
the lattice. 

5. Different measures of information context needed to 
be derived and compared to the current definition. Is the 
concept of measuring localized distance as defined by Meisel 
[2] a valid measure? Duda and Hart [l] also suggest several 
alternative measures. 

6. The effect of assigning to reference point one values 
other than the origin should be studied. 
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7. Is there any significant advantage to mapping through 
a series of distance spaces to further enhance relative 
proximity? This could be done by one mapping to, for 
example, two space followed by several two space to two 
space transformations. A second method would be to map from 
n space to n - 1 space to n - 2 space to ... to two space. 

8. Given that the data can be uniquely mapped into one 
dimension, can a reverse transformation be found to return 
the data to n dimensions? This question is complicated by 
the fact that the solution exist in nor continuous space. 
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APPENDIX A TEST DATA FROM CASE STUDY 1 



A. SAMPLE DATA 



Sample 
( 1. 1, 


1 ) 


Cl ass 
1 


Index number 
1 


( 1, 


3, 


2 ) 


1 


2 


( 2, 


1, 


3 ) 


1 


3 


( 3, 


2, 


1 ) 


1 


4 


( 4, 


4, 


4 ) 


2 


5 


( 3, 


4, 


4 ) 


2 


6 


( 6, 


5, 


4 ) 


3 


7 


( 4, 


5, 


6 ) 


T 

u 


8 


( 6, 


4, 


5 ) 


3 


9 


( 5, 


4, 


6 ) 


3 


10 



B. REFERENCE POINT TEST 



REFERENCE POINT I 2 



ITERATION 


1 








( - 


1* 


1, 


6 ) 


.0966678 


( 


6, 


1. - 


1 ) 


.0946914 


( - 


1, 


21, 


8 ) 


.2123157 


( 


6, - 


1. 


1 ) 


.0800436 


( 


1, “ 


1. 


6 ) 


.0798612 



99 



A . SAMPLE 



Sample 



( 1 , 2 , 0 
( 1 , 2 , 1 
( 1 , 2 , 2 
( 1, 2, 3 
( 1, 3, 0 
( 1, 3 f 1 
( 1, 3, 2 
( 1, 3, 3 
( 1 , 0 
( 1, 4, 1 
( 1, 4, 2 
( 1, 4, 3 
( 2, 4, 0 
( 2, 4, 1 
( 2, 4, 2 
( 2 t 4, 3 
( 2, 3, 0 
( 2, 3, 1 
( 2, 3, 2 
( 2, 3, 3 
( 3, 4, 0 
( 3, 4, 1 
( 3, 4, 2 
( 3, 4, 3 
( 2 , 1 , 0 
( 2, 1, 1 
( 2 , 1 , 2 
( 2, 1, 3 
( 3, 1, 0 
( 3, 1, 1 
( 3, 1, 2 
( 3, 1, 3 
( 3, 2, 0 
( 3, 2, 1 
( 3, 2, 2 
( 3, 2, 3 
( 4, 3, 0 
( 4, 3 f 1 



APPENDIX B TEST DATA FROM CASE STUDY 2 



DATA 



Class 



) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 



1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 



100 



( 4, 3, 2 ) 2 

( 4, 3, 3 ) 2 

( 4, 2, 0 2 

( 4, 2, 1 ) 2 

( 4, 2, 2 ) 2 

( 4, 2, 3 ) 2 

( 4, 1, 0 ) 2 

( 4, 1, 1 ) 2 

( 4, 1, 2 ) 2 



B. REFERENCE POINT TEST 

REFERENCE POINT 12 

1. ITERATION 1 



( - 


1. 




1. 


6 ) 


18.244934 


( 


6, 


- 


1, 


1 ) 


1.57519? 


( - 


1. 




21, 


8 ) 


.678884 


( 


6, 


- 


1, 


- 1 ) 


.632244 


( 


1, 


— 


1, 


6 ) 


16.244934 


ITERATION 2 










( 


21, 


— 


It 


18 ) 


1.534258 


( - 


1, 




16, 


21 ) 


2.392746 


( 


21, 




18, 


- 1 ) 


80.819992 


( 


18, 




21, 


- 1 ) 


80.819992 


( 


18, 


- 


1. 


21 ) 


2.392746 


( " 


1. 




12, 


15 ) 


2.391603 


( - 


1, 




15, 


12 ) 


1.246020 


( 


12, 


- 


1, 


15 ) 


2.391603 


( 


15, 


- 


1. 


12 ) 


1.266020 


( 


12, 




15, 


- 1 ) 


36.019989 


( 


15, 




12, 


- 1 ) 


36.019969 


( 


8, 


- 


1, 


1 ) 


.491111 


( 


10, 


- 


1. 


1 ) 


.454380 


( 


14, 


- 


1, 


1 ) 


.464800 


( 


20, 


— 


1* 


1 ) 


.514694 


Iteration 3 










( 


13, 


— 


1, 


1 ) 


.458060 


( 


12, 


- 


1, 


1 ) 


.453136 


( 


15, 


- 


1. 


1 ) 


.472577 


( 


16, 


- 


1, 


1 ) 


.480699 


( 


17, 


- 


1, 


1 ) 


.489444 


( 


18, 


- 


1. 


1 ) 


.49800? 


( 


19, 


- 


1. 


1 ) 


.506450 
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( 


16, 


- 


1, 


2 


) 


.480899 


( 


18, 


- 


1, 


2 


) 


.498007 


( 


19, 


- 


1, 


2 


) 


. 506450 


( 


20, 


- 


1, 


2 


) 


.514694 


( 


21 , 


- 


1, 


2 


) 


.522686 


( 


12, 


- 


1, 


3 


) 


.474437 


( 


14, 


- 


1. 


3 


) 


.480800 


( 


16, 


- 


1. 


3 


) 


.493355 


( 


18, 


- 


1, 


3 


) 


.507979 


( 


20, 


- 


1, 


3 


) 


.522857 


( 


40, 


- 


2, 


6 


) 


.602823 


( 


40, 




1, 


6 


) 


.748836 


Iteration 4 








t 




( 


12, 


— 


3, 


1 


) 


.336800 


( 


12, 




4, 


1 


) 


.303828 


( 


12, 


- 


6, 


1 


) 


.267222 


( 


12, 


- 


12, 


1 


) 


.262812 


( 


12, 


- 


15, 


1 


) 


.281728 


( 


12, 


— 


20, 


1 


) 


.319706 


Iteration 5 












( 


12, 


— 


13, 


1 


) 


.268448 


( 


12, 


- 


14, 


1 


) 


.274821 


( 


12, 


- 


16, 


1 


) „ 


.289005 


( 


12, 


- 


17, 


1 


) 


.296527 


( 


12, 


- 


90, 


1 


) 


.599325 


( 


12, 


— 


99, 


1 


) 


.613893 


Iteration 6 












( - 


12, 




12, 


2 


) 


.262612 


( - 


12, 




12, 


7 


) 


.356562 


( - 


12, 




12, 


13 


) 


.675312 


( - 


12, 




12, 


21 


) 


1.450312 


( - 


12, 




12, 


27 


) 


2.294062 


Iterat 


ion 7 












( - 


12, 




12, 


3 


) 


.269062 


( - 


12, 




12, 


5 


) 


.300312 


( - 


50, 




50, 


3 


) 


.203979 


( 


50 , 


- 


50, 


5 


) 


.205779 


( - 


99, 




99, 


1 


) 


.200923 


( - 


99, 




99, 


10 


) 


.204229 


( 


99, 


— 


99, 


10 


) 


.207513 


Iterat 


ion £ 
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( 99, - 


99, 


1 ) 


.200923 


( 150, - 


150, 


1 ) 


.200402 


( 200, - 


200, 


1 ) 


.200232 


( - 150, 


150, 


1 ) 


.200402 


( - 200, 


200, 


1 ) 


.200232 


( - 99, 


99, 


3 ) 


.200923 


( - 50, 


50, 


1 ) 


.201015 


( 50, - 


50, 


3 ) 


.203619 


Iteration 9 








( 300, - 


300, 


1 ) 


.200100 


( 300, - 


300, 


3 ) 


.200110 


( - 300, 


300, 


5 ) 


.200160 


( - 300, 


300 , 


30 ) 


.204160 


Iteration 10 








( 350, - 


350, 


1 ) 


.200077 


( - 400, 


400 , 


1 ) 


.200053 


( - 500, 


500, 


1 ) 


.200038 


( - 500, 


500, 


100 ) 


.217502 


( - 400, 


400 , 


130 ) 


.227340 


Iteration 11 








( 600, - 


600, 


1 ) 


.200025 


( - 700, 


700, 


3 ) 


.200018 


( 800, - 


800 , 


1 ) 


.200191 


( - 999, 


999, 


1 ) 


.200312 


( 999, - 


999, 


3 ) 


.200012 
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APPENDIX C TEST DATA FROM CASE STUDY 3 



A. SAMPLE DATA 



Sarnple 


Class 


( 3, 3, 2 ) 


1 


( 3, 3, 3 ) 


1 


( 3, 2, 2 ) 


1 


( 3, 2, 3 ) 


1 


( 3, 4, 2 ) 


1 


( 3, 4, 2 ) 


1 


( 3, 4 t 3 ) 


1 


( 4, 3, 2 ) 


1 


( 4, 3, 3 ) 


1 


( 2, 3, 3 ) 


1 


( 2, 3, 2 ) 


1 


( 1, 1, 0 ) 


2 


( 1, 2, 0 ) 


2 


( 1, 3, 0 ) 


2 


( 1, 4, 0 ) 


2 


(1,5,0) 


2 


( 2, l t 0 ) 


2 


( 2, 2, 0 ) 


2 


( 2, 3, 0 ) 


2 


( 2 t 4, 0 ) 


2 


( 2, 5, 0 ) 


2 


( 3, 1, 0 ) 


2 


( 3, 2, 0 ) 


2 


( 3, 3, 0 ) 


2 


( 3, 4 t 0 ) 


2 


( 3, 5, 0 ) 


2 


( 4, 1, 0 ) 


2 


( 4, 2 t 0 ) 


2 


( 4, 3, 0 ) 


2 


( 4, 4, 0 ) 


2 


( 4, 5, 0 ) 


2 


( 5, 1, 0 ) 


2 


( 5, 2, 0 ) 


2 


( 5, 3, 0 ) 


2 


( 5, 4, 0 ) 


2 


( 5, 5, 0 ) 


2 


( 1, 1, 5 ) 


2 


( 1, 2, 5 ) 


2 
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1 

1 

1 

2 

2 

2 

2 

2 

3 

3 

3 

3 

3 

4 

4 

4 

4 

4 

5 

5 

5 

5 

5 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

5 

5 

5 

5 

5 

5 

5 

5 



3, 5 ) 2 

4, 5 ) 2 

5, 5 ) 2 

1, 5 ) 2 

2, 5 ) 2 

3, 5 ) 2 

4, 5 ) 2 

5, 5 ) 2 

1, 5 ) 2 

2, 5 ) 2 

3, 5 ) 2 

4, 5 ) 2 

5, 5 ) 2 

1, 5 ) 2 

2, 5 ) 2 

3, 5 ) 2 

4, 5 ) 2 

5, 5 ) 2 

1, 5 ) 2 

2, 5 ) 2 

3, 5 ) 2 

4, 5 ) 2 

5, 5 ) 2 

1 . 1 ) 2 

2 , 1 ) 2 

3, 1 ) 2 

4, 1 ) 2 

5, 1 ) 2 

1 , 2 ) 2 

2 , 2 ) 2 

3, 2 ) 2 

4, 2 ) 2 

5, 2 ) 2 

1, 3 ) 2 

2, 3 ) 2 

3, 3 ) 2 

4, 3 ) 2 

5, 3 ) 2 

1, 4 ) 2 

2, 4 ) 2 

3, 4 ) 2 

4, 4 ) 2 

5, 4 ) 2 

1 . 1 ) 2 

2 , 1 ) 2 

3, 1 ) 2 

4, 1 ) 2 

5, 1 ) 2 

1 , 2 ) 2 

2 , 2 ) 2 

3 , 2 ) 2 
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(=, 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

3 

4 



4 

5 
1 
2 

3 

4 

5 
1 
2 

3 

4 

5 
5 
5 
5 
5 
5 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
5 
5 
5 
5 
5 
5 
5 
5 
5 
5 
0 
0 
0 
0 
0 
5 
5 
5 
5 



2 

2 

3 

3 

3 

3 

3 

4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
1 
1 
1 
1 
1 
2 
2 
2 
2 
2 
1 
1 
1 
1 
1 
2 
2 
2 
2 
2 
3 
3 
3 
3 
3 
3 
3 
3 
3 



2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 
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( 5, 5, 3 ) 



2 



B. REFERENCE POINT TEST 

REFERENCE POINT I 

1. ITERATION 1 



( 


21, 


- 


01, 


18 ) 


506.106934 


( - 


1, 




18, 


21 ) 


560.919434 


( 


21, 




18, 


- 1 ) 


274.674023 


( 


18, 




21, 


- 1 ) 


274.874023 


( 


18, 


— 


1, 


21 ) 


560.919434 


ITERATION 


1 2 










( 


13, 


— 


1, 


1 ) 


165.419464 


( 


12, 


- 


1, 


1 ) 


148 .707S62 


( 


15, 


- 


1, 


1 ) 


230.934296 


( 


16, 


- 


1, 


1 ) 


219.476013 


( 


1?, 


- 


1, 


1 ) 


238.391846 


( 


18, 


- 


1, 


1 ) 


257.587891 


( 


19, 


- 


1, 


1 ) 


276.977295 


( 


16, 


- 


1* 


2 ) 


217.550034 


( 


18, 


- 


1, 


2 ) 


255.603177 


( 


19, 


- 


1, 


2 ) 


275.258789 


( 


20, 


- 


1, 


2 ) 


294.842041 


( 


21, 




1, 


2 ) 


314.477783 


( 


12, 


- 


1, 


3 ) 


146.451431 


( 


14, 


- 


1, 


3 ) 


180.792053 


( 


16, 


- 


1, 


3 ) 


217.550156 


( 


18, 


- 


1, 


3 ) 


255.803207 


( 


20, 


- 


1, 


3 ) 


294.842041 


( 


40, 


- 


2, 


6 ) 


6 86.030518 


( 


40, 




1, 


6 ) 


621 .195801 


ITERATION 3 










( - 


1, 




12, 


15 ) 


322.457764 


( - 


1, 




15, 


12 ) 


289.038574 


( 


12, 


- 


1, 


15 ) 


322 .457520 


( 


15, 


- 


1, 


12 ) 


289.038086 


( 


12, 




15, 


- 1 ) 


178.622330 


( 


15, 




12, 


- 1 ) 


178.622330 


( 


8, 




12, 


- 1 ) 


92.765416 


( 


10, 


- 


1, 


1 ) 


118.168716 


( 


14, 


- 


1, 


1 ) 


182 .874771 


( 


20, 


- 


1, 


1 ) 


296.498291 


( - 


1, 




1, 


6 ) 


95 .093445 
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( 6 , 

( 1 . 

4. ITERATION 4 

( 6 , 

( 20 , 

( - 

( - e, 
( ~ 6 , 
( 6 , 
( 1 . 
( - 10 , 

5. ITERATION 5 

( 36, 

( 360, 

( 64, 

( - 500, 
( 36, 

( 360, 

( 640, 

( 80 , 



21 , 9 ) 

1 , 1 ) 

1 , 6 ) 



1 , 6 ) 
6, - 5 ) 

4, 6 ) 

20 , 6 ) 
11 , 6 ) 
14, - 7 ) 

e, 6 ) 

17, 6 ) 



6 , - 1 ) 
60, - 1 ) 
- 8 , 1 ) 
500, 6 ) 

- 6 , 1 ) 
-60, 1 ) 
-80, 1 ) 
8 , - 1 ) 



66.218964 

338.431396 

74.488647 

95.093933 



146.091446 

263,564941 

281.805176 

435.876953 

275.054688 

206.950363 

388.758789 

567.541748 



487.041504 

1335.837891 

1160.075684 

17896 ee. 000000 

731 .306641 
2534 . 004395 
2574.547363 
9 42.906250 
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APPENDIX D TEST DATA FROM CASE STUDY 4 



A. SAMPLE DATA 







1. 


CASE 1 












Class 


1 


Class 


2 




( 


7, 


4, 


4 ) 


( 16, 


19, 


21 


) 


( 


5, 


*7 

^ f 


2 ) 


( 20, 


21, 


19 


) 


( 


2 , 


3, 


4 ) 


( 22, 


19, 


17 


) 


( 


5, 


2, 


4 ) 


( 22, 


19, 


18 


) 


( 


6, 


6, 


2 ) 


( 20, 


20, 


24 


) 


( 


4, 


5, 


0 ) 


( 17 * 


19, 


18 


) 


( 


4, 


3, 


2 ) 


( 22, 


22, 


19 


) 


( 


6, 


3, 


2 ) 


( 21, 


21, 


18 


) 


( 


5, 


2, 


5 ) 


( 26, 


21, 


21 


) 


( 


0, 


5, 


4 ) 


( 19, 


21, 


17 


) 


( 


4, 


3, 


1 ) 


( 21, 


15, 


20 


) 


( 


3, 


2, 


8 ) 


( 18, 


19, 


21 


) 







2, 


CASE 2 












Class 


1 


Class 


2 




( 


9, 


6, 


5 ) 


( 14, 


17, 


19 


) 


( 


7, 


* 

^ ♦ 


4 ) 


( 18, 


19, 


17 


) 


( 


4. 


5, 


6 ) 


( 20, 


17, 


15 


) 


( 


7, 


4, 


6 ) 


( 20, 


17, 


16 


) 


( 


8, 


8, 


4 ) 


( 18, 


18, 


24 


) 


( 


6, 


7, 


2 ) 


( 15, 


17, 


16 


) 


( 


6, 


5, 


4 ) 


( 18, 


20, 


17 


) 


( 


8, 


5, 


4 ) 


( 19, 


19, 


16 


) 


( 


7, 


4, 


7 ) 


( 24, 


19, 


19 


) 


( 


0, 


7, 


6 ) 


( 17, 


19, 


15 


) 


( 


6, 


5, 


3 ) 


( 19, 


21, 


16 


) 


( 


5, 


4, 


10) 


( 18, 


19, 


22 


) 
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3. CASE 3 



Class 1 



( 


11. 


8, 


7 


) 


( 


9, 




6 


) 


( 


6, 


8, 


8 


) 


( 


9, 


6, 


8 


) 


( 


10. 


10, 


6 


) 


( 


8, 


9, 


4 


) 


( 


8, 


7, 


6 


) 


( 


10, 


7, 


6 


) 


( 


9, 


6, 


9 


) 


( 


1, 


9, 


8 


) 


( 


8, 


7, 


5 


) 


( 


7, 


6, 


12 


) 



4. CASE 4 





Class 1 






( 


13, 


10, 


9 


) 


( 


11, 


9, 


8 


) 


( 


8, 


9, 


10 


) 


( 


11, 


8, 


10 


) 


( 


12, 


12, 


8 


) 


( 


10, 


11, 


6 


) 


( 


10, 


9, 


8 


) 


( 


12, 


9, 


8 


) 


( 


11, 


8, 


11 


) 


( 


3, 


11, 


10 


) 


( 


10, 


9, 


7 


) 


( 


9, 


8, 


14 


) 






5. 


CASE 


5 



Class 1 



( 


15, 


12, 


11 


) 


( 


13, 


U, 


10 


) 


( 


10, 


11, 


12 


) 


( 


13, 


10, 


12 


) 


( 


14, 


14, 


10 


) 


( 


12, 


13, 


8 


) 


( 


12, 


11, 


10 


) 


( 


14, 


U, 


10 


) 


( 


13, 


10, 


13 


) 


( 


6, 


13, 


12 


) 


( 


12, 


U, 


9 


) 


( 


11, 


10, 


16 


) 





Class 


2 




( 


12, 


15, 


17 


) 


( 


16, 


17, 


15 


) 


( 


18, 


15, 


13 


) 


( 


18, 


15, 


14 


) 


( 


16, 


16, 


22 


) 


( 


13, 


15, 


14 


) 


( 


16, 


18, 


15 


) 


( 


17, 


17, 


14 


) 


( 


22, 


17, 


17 


) 


( 


15, 


17, 


13 


) 


( 


17, 


19, 


14 


) 


( 


16, 


17, 


20 


) 







Class 


2 




( 


10, 


13, 


15 


) 


( 


14, 


15, 


13 


) 


( 


16, 


13, 


11 


) 


( 


16, 


13, 


12 


) 


( 


14, 


14, 


20 




( 


11, 


13, 


12 


j 


( 


14, 


16, 


13 


) 


( 


15, 


15, 


12 


) 


( 


20, 


15, 


15 


) 


( 


13, 


15, 


11 


) 


( 


15, 


17, 


12 


) 


( 


14, 


15, 


18 


) 







Class 2 




( 


8, 


11, 


13 


) 


( 


12, 


13, 


11 


) 


( 


14, 


11, 


9 


) 


( 


14, 


11, 


10 


) 


( 


12, 


12, 


18 


) 


( 


9, 


11, 


10 


) 


( 


12, 


14, 


11 


) 


( 


13, 


13, 


10 


) 


( 


18, 


13, 


13 


) 


( 


11, 


13, 


9 


) 


( 


13, 


15, 


10 


) 


( 


12, 


13, 


16 


) 
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B. REFERENCE POINT TEST 



REFERENCE POINT I 2 

1. CASE 1 





Iteration 


1 






( 


- It 


42, 


1 ) 


0.093977 


( 


42, - 


It 


1 ) 


.106397 


( 


- It 


57, 


42 ) 


.029866 


( 


- 1, 


47, 


125 ) 


. 045806 


( 


77, 


77, 


1 ) 


.034925 


( 


77, 


77, 


77 ) 


.014635 


( 


127, - 


127, 


3 ) 


.029114 


( 


- 1, - 


6, 


1 ) 


.037278 


( 


- 73, - 


6, 


- 1 ) 


.046832 




Iteration 


2 






( 


999, 


999, 


999 ) 


.016088 


( 


999, 


999, 


1 ) 


.029569 


( 


500, 


500, 


500 ) 


.015915 


( 


500, 


500, 


1 ) 


.029797 


( 


500, 


500, 


999 ) 


.020086 


( 


500, 


509, 


- 999 ) 


25.971329 




I teration 


3 






( 


125, 


125, 


125 ) 


.015041 


( 


250, 


250, 


250 ) 


.015589 


( 


1, 


100, 


100 ) 


.023590 


( 


500, 


500, 


- 1 ) 


.029975 


( 


- 999, - 


999, 


999 ) 


.234499 


( 


- 999, - 


999, 


- 999 ) 


.016451 


( 


500, - 


500, 


500 ) 


.203192 




Iteration 


4 






( 


55, 


55, 


55 ) 


.014684 


( 


67, 


67, 


67 ) 


.014588 


( 


73, 


73, 


73 ) 


.014609 


( 


33, 


33, 


33 ) 


.017653 


( 


27, 


27, 


27 ) 


.021412 


( 


49, 


49, 


49 ) 


.014898 




Iteration 


5 






( 


66, 


66, 


66 ) 


.014587 


( 


63, 


63, 


63 ) 


.014592 


( 


69, 


69, 


69 ) 


.014592 


( 


61, 


61, 


61 ) 


.014602 


( 


59, 


59, 


59 ) 


.014620 
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( 


57, 


57, 


57 


) 


.014646 


CASE 


2 










a 


• 


Iteration 


1 










( 


1, 


42, 


1 


) 


.127064 




( 


42, - 


1. 


1 


) 


.186043 




( 


- 1, 


57, 


42 


) 


.043038 




( 


- 1, 


47, 


125 


) 


.088665 




( 


77, 


77, 


1 


) 


. 05836 1 




( 


77, 


77, 


77 


) 


.027151 




( 


- 127, - 


127, 


3 


) 


.045052 




( 


" 1, - 


6, 


1 


) 


.051349 




( 


- 73, - 


6, 


- 1 


) 


.080489 


b 


• 


Iteration 


2 










( 


999, 


999, 


999 


) 


.028986 




( 


999, 


999, 


1 


) 


.047432 




( 


500, 


500, 


500 


) 


.028773 




( 


500, 


500, 


1 


'i 


.047993 




( 


500, 


500, 


999 


) 


.038980 




( 


500, 


500, 


-999 


) 


109.819839 


c 


• 


Iteration 


3 










( 


55, 


55, 


55 


) 


.027149 




( 


67, 


67, 


67 


) 


.027073 




( 


73, 


73, 


73 


) 


.027113 




( 


33, 


33, 


33 


) 


.030525 




( 


27, 


27, 


27 


) 


.034905 




( 


49, 


49, 


49 


) 


.027375 


d 


• 


I terat ion 


4 










( 


66, 


66, 


66 


) 


.027069 




( 


63, 


63, 


63 


) 


.027066 




( 


69, 


69, 


69 


) 


.027083 




( 


61, 


61, 


61 


) 


.027073 




( 


59, 


59, 


59 


) 


.027087 




( 


57, 


57, 


57 


) 


.027112 



CASE 3 






a. Iteration 1 






( - 1, 42, 


1 ) 


.240905 
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( 




42, 


- 


1. 


1 ) 


.405388 


( 


- 


1, 




57, 


42 ) 


.091247 


( 


- 


1, 




47, 


125 ) 


.192553 


( 




77, 




77, 


1 ) 


.129220 


( 




77, 




77, 


77 ) 


.061053 


( 


- 


127, 


- 


127, 


3 ) 


.097261 


( 


- 


1, 


- 


6, 


1 ) 


.090916 


( 


— 


73, 


— 


6, 


- 1 ) 


.177960 




Iteration 


2 






( 




999, 




999, 


999 ) 


.063691 


( 




999, 




999, 


-999 ) 


.910851 


( 


- 


999, 


- 


999, 


-999 ) 


.064311 


( 


- 


It 


- 


153, 


1 ) 


.065192 


( 


- 


999, 


- 


999, 


- 1 ) 


.102021 


( 


- 


999, 


- 


999, 


1 ) 


.102291 


( 


— 


30, 


— 


180, 


1 ) 


.060995 




I teration 


3 






( 


— 


153, 


— 


900, 


1 ) 


.064361 


( 




66, 




66, 


66 ) 


.060896 


( 




63, 




63, 


63 ) 


.060875 


( 


- 


180, 


- 


30, 


1 ) 


.207636 


( 


- 


75, 


- 


450, 


1 ) 


.063134 


( 




75, 




450, 


- 1 ) 


.071101 


( 




30, 




180, 


- 1 ) 


.083405 



d. Iteration 4 



( 




30, - 


183, 


1 


) 


.061042 


( 


- 


27, - 


180, 


1 


) 


.061103 


( 


- 


27, - 


183, 


1 


) 


.061164 


( 




30, - 


180, 


- 1 


) 


.062224 


( 


- 


30, - 


180, 


- 30 


) 


.049189 


( 


- 


33, - 


180, 


- 33 


) 


.049178 


( 


- 


30, - 


180, 


1 


) 


.060965 


( 


— 


30, - 


177, 


1 


) 


.060952 




Iteration 


5 








( 


— 


150, - 


900, 


-900 


) 


.066459 


( 


- 


150, - 


900, 


-150 




.048069 


( 


- 


33, - 


180, 


- 99 


j 


. 049638 


( 


- 


99, - 


540, 


- 99 


) 


.047232 


( 




180, 


33, 


33 


) 


.209693 


( 




900, 


150, 


900 


) 


.120490 


( 


- 


160, - 


960, 


- 40 


) 


.058638 


( 


- 


10, - 


60, 


- 2 


) 


.059914 


( 


- 


15, - 


90, 


- 4 


) 


.057103 
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- 120, - 20, 5 ) 

- 120, - 20,- 5 ) 



.200673 

.178624 



4. CASS 4 



a. Iteration 1 



( - 


1, 


42, 


1 ) 


.712316 


( 


42, 


- 1, 


1 ) 


1.297319 


( - 


1, 


57, 


42 ) 


.287248 


( - 


1, 


47, 


125 ) 


.656638 


( 


77, 


77, 


1 ) 


.445736 


( 


77, 


77, 


77 ) 


.214881 


( - 


127, 


- 127, 


3 ) 


.331711 


( - 


1, 


- 6, 


1 ) 


.257414 


( - 


73, 


- 6, 


- 1 ) 


.618422 



b. Iteration 2 



( - 


30, 


- 180, 


1 ) 


.194983 


( 


999, 


999, 


999 ) 


.220502 


( - 


999, 


- 999, 


0 ) 


.352891 


( - 


999, 


- 999, 


1 ) 


.353415 


( - 


999, 


- 999,- 


1 ) 


.352478 


( 


999, 


999, 


0 ) 


.363830 


( - 


150, 


- 900, 


1 ) 


.208534 


( - 


150, 


- 900,- 


1 ) 


.207464 


( 


66, 


66, 


66 ) 


.214384 


( 


63, 


63, 


63 ) 


.214271 


( . 


59, 


59, 


59 ) 


.214157 


( 


57, 


57, 


57 ) 


.214122 


( 


61, 


61, 


61 ) 


. 21420e 


( 


67, 


67, 


67 ) 


.214425 



c. Iteration 3 



( 


- 


40, 


- 


240, 


1 ) 


.197993 


( 


- 


40, 


- 


240, 


10 ) 


.182372 


( 


- 


40, 


- 


240, 


0 ) 


.196409 


( 


- 


50, 


- 


300, 


0 ) 


.198964 


( 


- 


50, 


— 


300, 


50 ) 


.301546 


( 


- 


20, 


- 


120, 


1 ) 


.191039 


( 


- 


20, 


- 


120,- 


5 ) 


.178492 


( 


- 


30, 


- 


190, 


1 ) 


.195347 


( 


- 


30, 


- 


170, 


0 ) 


.192591 



d . Iteration 4 



( 



150, - 900,-900 ) 



.219152 
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( - 


150, 


- 900,-150 ) 


.15610? 


( - 


33, 


- 180,- 99 ) 


.159531 


( - 


99, 


- 540,- 99 ) 


.153407 


( 


180, 


33, 33 ) 


.761994 


( 


900 , 


150, 900 ) 


.430386 


( - 


160, 


- 960,- 40 ) 


.190221 


( - 


10, 


- 60,- 2 ) 


.182952 


( - 


120, 


-20, 5 ) 


.708054 



5. CASE 5 



a. Iteration 1 



( 


- 


1, 




42, 


1 ) 


ie. 325668 


( 




42, 


- 


1, 


1 ) 


38.237442 


( 


- 


1, 




57, 


42 ) 


8.180267 


( 


- 


1, 




47, 


125 ) 


28.016891 


( 




??, 




77, 


1 ) 


21.455872 


( 




77, 




77, 


77 ) 


11.546129 


( 


- 


127, 


- 


127, 


3 ) 


15.333944 


( 


- 


1, 


- 


6, 


1 ) 


9.163347 


( 


— 


73, 


— 


6, 


- 1 ) 


53.390564 




Iteration 


2 






( 


— 


150, 




900, 


1 ) 


5.632728 


( 


- 


30, 


- 


180, 


1 ) 


5.433392 


( 


- 


?5, 


- 


450, 


1 ) 


5.564706 


( 




0, 


1011, 


7008 ) 


41.082291 


( 




1, 




86 , 


63 ) 


7.130882 


( 


- 


1, 




234, 


168 ) 


6.409952 


( 


— 


150, 


— 


900, 


0 ) 


5.621341 




Iteration 


3 






( 


_ 


40, 


— 


240, 


1 ) 


5.484715 


( 


- 


40 , 


- 


240, 


- 10 ) 


5.150225 


( 


- 


40, 


- 


240, 


0 ) 


5.450282 


( 


- 


50, 


- 


300, 


0 ) 


5.485142 


( 


- 


50, 


- 


300, 


50 ) 


7.647579 


( 


- 


20, 


- 


120, 


1 ) 


5.441672 


( 


- 


20, 


- 


120, 


- 5 ) 


5.168211 


( 


- 


30, 


- 


190, 


1 ) 


5.413536 


( 


- 


30, 


- 


170, 


0 ) 


5.458068 



d. Iteration 4 



( - 150, - 900,-900 ) 

( - 150, - 900,-150 ) 



8.136481 

4.560885 
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- 33 , - 

( - 99 , - 

( 180 , 

( 900 , 

( - 160 , - 
( - 10, - 
( - 120, - 
( - 120, - 



180 , 


- 99 


) 


540 , 


- 99 


) 


33 , 


33 


) 


150 , 


900 


) 


960 , 


- 40 


) 


60 , 


- 2 


) 


20 , 


5 


) 


20 , 


- 5 


) 



5.401924 

4.591217 

99.351578 

38.806274 

5.247062 

5.492326 

66.094223 

57.096405 
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APPENDIX E TEST DATA FROM CASE STUDY 5 



A. SAMPLE DATA 

1. CASE 1 



( a , d. 

Class 1 

( 5, 3, 

( 4,4, 

( 0, 5, 

( 5,4, 

( 3, 8, 

( 5, 4, 

( 5,4, 

( 2 , 2 , 

( 4, 7, 

( 4, 3, 

( 4,5, 

( 5,2, 

( 3,0, 

( 4, 4, 

( 7,4, 

( 6 , 2 , 



c, d, 6, ?, 

3, 4, 1, 4, 

5, 4, 3, 6, 

5, 4, 3, 6, 

3, 5, 4, 2, 

3, 4, 4, 6, 

5, 4, 1, 7, 

4, 4, 4, 4, 

4, 7, 6, 4, 

6, 3, 4, 5 , 

5, 4, 4, 4, 

3, 7 , 3, 4, 

4, 6, 2, 1, 

7 4 4 ^ 

r 9 w f 

5, 5, 1, 4, 

3, 4, 1, 4, 

0, 4, 2, 6, 



g. h, i, j ) 

5, 5, 5, 1 ) 

4, 6, 0, 2 ) 

8, 2, 4, 3 ) 

5, 6, 4, 3 ) 

3, 5, 1, 4 ) 

1, 0, 3, 2 ) 

5, 3, 6, 2 ) 

6, 2, 3, 6 ) 

2, 5, 3, 5 ) 

4, 5, 7, 4 ) 

4, 4, 6, 3 ) 

7, 4, 2, 6 ) 

2, 4, 4, 4 ) 

3, 4, 4, 4 ) 

4, 4, 4, 7 ) 

5, 2, 4, 6 ) 



Class 2 



( 


16, 


12, 


18, 


16, 


15, 


19, 


16, 


15, 


16, 


17 


) 


( 


IT, 


14, 


19, 


16, 


16, 


13, 


15, 


14, 


16, 


18 


) 


( 


14, 


16, 


15, 


15, 


19, 


13, 


14, 


16, 


19, 


18 


) 


( 


16, 


18, 


15, 


15, 


15, 


15, 


IT, 


15, 


IT, 


17 


) 


( 


16, 


16, 


11, 


18, 


15, 


13, 


14, 


15, 


16, 


14 


) 


( 


13, 


16, 


15, 


16, 


19, 


15 v 


15, 


16, 


20, 


16 


) 


( 


12, 


16, 


16, 


IT, 


16, 


IT, 


19, 


18, 


16, 


16 


) 


( 


16, 


15, 


15, 


IT, 


16, 


IT, 


16, 


16, 


16, 


17 


) 


( 


16, 


16, 


14, 


19, 


16, 


16, 


16, 


IT, 


18, 


17 


) 


( 


1?, 


15, 


IT, 


IT, 


16, 


15, 


16, 


IT, 


18, 


13 


) 


( 


IT, 


18, 


IT, 


16, 


15, 


16, 


19, 


19, 


16, 


16 


) 


( 


14, 


18, 


12, 


IT, 


13, 


13, 


IT, 


IT, 


15, 


16 


) 


( 


16, 


13, 


16, 


13, 


16, 


16, 


18, 


16, 


16, 


16 


) 


( 


18, 


14, 


15, 


16, 


14, 


16, 


16, 


16, 


19, 


16 


) 


( 


16, 


18, 


16, 


19, 


IT, 


18, 


15, 


IT, 


18, 


13 


) 


( 


13, 


16, 


16, 


18, 


IT, 


14, 


16, 


18, 


16, 


18 


) 
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2. CASE 2 



Class 1 



( 


5, 


7, 


4, 


6, 


6, 


8, 


8, 


5, 


6, 


6 


) 


( 


3, 


2, 


4, 


e, 


3, 


5, 


7, 


3, 


6, 


8 


) 


( 


8, 


4, 


6, 


5, 


e; 

^ ♦ 


5, 


4, 


5, 


6, 


5 


) 


( 


* 

~ » 


7, 


3, 


7, 


8, 


5, 


8, 


6, 


9, 


11 


) 


( 


6, 


fit 


7, 


4, 


4, 


2, 


9, 


11, 


9, 


9 


) 


( 


4, 


10, 


6, 


4, 


6, 


6, 


6, 


6, 


5, 


8 


) 


( 


6, 


6, 


7, 


6, 


9, 


6, 


G, 

*- * 


6, 


8, 


6 


) 


( 


6, 


3, 


6, 


8, 


5, 


6, 


6, 


5, 


7, 


4 


) 


( 


4, 


6, 


5, 


8, 


6, 


6, 


2, 


6, 


5, 


6 


) 


( 


4, 


7, 


6, 


6, 


7, 


6, 


7, 


6, 


4, 


5 


) 


( 


8, 


6, 


6, 


5, 


6, 


8, 


4, 


6, 


7, 


8 


) 


( 


7, 


7, 


6, 


9, 


6, 


5, 


5, 


6, 


7, 


6 


) 


( 


2, 


7, 


4, 


5, 


9, 


6, 


9, 


6, 


4, 


6 


) 


( 


3, 


e, 


2, 


3, 


8, 


5, 


4, 


6, 


5, 


6 


) 


( 


5, 


3, 


5, 


6, 


10, 


8, 


4, 


5, 


6, 


4 


) 



Class 2 



( 


17, 


21, 


14, 


15, 


15, 


14, 


14, 


14, 


15, 


15 


) 


( 


16, 


16, 


14, 


14, 


14, 


15, 


15, 


14, 


14, 


14 


) 


( 


14, 


16, 


13, 


15, 


19, 


12, 


17, 


14, 


17, 


15 


) 


( 


11, 


15, 


14, 


15, 


15, 


16, 


14, 


16, 


14, 


14 


) 


( 


14, 


15, 


14, 


15, 


15, 


13, 


15, 


12, 


12, 


10 


) 


( 


13, 


15, 


12, 


14, 


14, 


14, 


13, 


16, 


14, 


14 


) 


( 


15, 


15, 


14, 


17, 


15, 


17, 


12, 


11, 


11 , 


12 


) 


( 


14, 


13, 


13, 


15, 


14, 


15, 


17, 


14, 


14, 


16 


) 


( 


14, 


14, 


12, 


16, 


15, 


14, 


15, 


13, 


13, 


17 


) 


( 


18, 


16, 


14, 


14, 


13, 


14, 


13, 


13, 


14, 


13 


) 


( 


14, 


14, 


12, 


12, 


14, 


11 , 


12, 


U, 


14, 


14 


) 


( 


13, 


13, 


13, 


14, 


14, 


13, 


15, 


14, 


14, 


15 


) 


( 


17, 


12, 


14, 


13, 


14, 


14, 


12, 


13, 


16, 


15 


) 


( 


16, 


16, 


14, 


13, 


16, 


13, 


14, 


13, 


11, 


14 


) 


( 


13, 


14, 


14, 


11, 


13, 


16, 


16, 


14, 


14, 


14 


) 


( 


14, 


17, 


11, 


12, 


13, 


14, 


14, 


14, 


14, 


18 


) 



118 



3. CASE 3 



Class 1 



( 


8, 


8, 


8, 


10, 


7, 


7, 


8, 


8, 


7, 


7 


) 


( 


12, 


7, 


8, 


8, 


7, 


9, 


10, 


8, 


7, 


3 


) 


( 


7, 


12, 


6, 


13, 


7, 


7, 


8, 


9, 


9, 


8 


) 


( 


11, 


8, 


8, 


8, 


8, 


10, 


11, 


8, 


8, 


6 


) 


( 


8, 


8, 


8, 


8, 


10, 


8, 


7, 


3, 


6, 


8 


) 


( 


11. 


10, 


6, 


8, 


10, 


8, 


10, 


10, 


9, 


9 


) 


( 


9, 


6, 


8, 


8, 


8, 


10, 


o 

t 


7, 


5 , 


8 


) 


( 


7, 


7, 


9, 


6, 


10, 


7, 


10, 


8, 


8, 


9 


) 


( 


9, 


9, 


10, 


7, 


7, 


7. 


6, 


9, 


8, 


9 


) 


( 


7, 


9, 


7, 


7, 


8, 


6, 


7, 


10. 


10, 


10 


) 


( 


8, 


9, 


8, 


9, 


10, 


8, 


14, 


10, 


6, 


11 


) 


( 


8, 


11, 


7, 


8, 


6, 


8, 


7, 


9, 


8, 


9 


) 


( 


9, 


7, 


8, 


9, 


7, 


9, 


6, 


8, 


8, 


10 


) 


( 


9, 


8, 


8, 


7, 


8, 


10, 


6, 


4, 


7, 


7 


) 


( 


9, 


8, 


10, 


8, 


6, 


8, 


8, 


9, 


6, 


8 


) 



Class 2 



( 


12, 


12, 


10, 


12, 


12, 


13, 


12, 


13, 


12, 


12 


) 


( 


13, 


13, 


15, 


12, 


8, 


13, 


14, 


9, 


12, 


14 


) 


( 


13, 


13, 


13, 


12, 


12, 


10, 


14, 


12, 


11, 


12 


) 


( 


12, 


10, 


14, 


16, 


13, 


16, 


10, 


10, 


14, 


13 


) 


( 


11, 


12, 


8, 


12, 


12, 


11, 


U, 


9, 


11, 


11 


) 


( 


12, 


12, 


12, 


13, 


12, 


14, 


13, 


12, 


11 , 


13 


) 


( 


12, 


U, 


12, 


13, 


15, 


12, 


8, 


12, 


11, 


14 


) 


( 


12, 


12, 


13, 


12, 


13, 


14, 


15, 


11, 


8, 


15 


) 


( 


14, 


15, 


11, 


11, 


11, 


13, 


10, 


13, 


12, 


12 


) 


( 


12, 


13, 


13, 


13, 


12, 


11. 


12, 


12, 


11. 


13 


) 


( 


8, 


14, 


14, 


10, 


U, 


12, 


11, 


14, 


11, 


12 


) 


( 


12, 


13, 


12, 


12, 


9, 


12, 


14, 


12, 


10, 


10 


) 


( 


12, 


13, 


9, 


14, 


12, 


11, 


14, 


12, 


11, 


12 


) 


( 


12, 


13, 


13, 


12, 


12, 


14, 


U, 


12, 


14, 


12 


) 


( 


12, 


13, 


14, 


11, 


12, 


12, 


12, 


13, 


15, 


12 


) 


( 


14, 


13, 


13, 


14, 


15, 


9, 


14, 


16, 


12, 


11 


) 
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4. CASE 4 



Class 1 



( 


9, 


10, 


13, 


11, 


11, 


11, 


10, 


12, 


9, 


10 


) 


( 


10, 


10, 


10, 


8, 


14, 


9, 


10, 


9, 


9, 


10 


) 


( 


10, 


9, 


12, 


9, 


9, 


10, 


9, 


9, 


10, 


10 


) 


( 


12, 


U, 


17, 


10, 


11, 


12, 


15, 


11, 


10, 


10 


) 


( 


10, 


7, 


11, 


12, 


10, 


10, 


10, 


9, 


8, 


10 


) 


( 


10, 


10, 


10, 


11, 


9, 


10, 


11, 


10, 


9, 


10 


) 


( 


10, 


9, 


10, 


9, 


8, 


13, 


11, 


10, 


8, 


9 


) 


( 


11, 


10, 


8, 


8, 


7, 


13, 


7, 


12, 


10, 


10 


) 


( 


10, 


10, 


8, 


10, 


10, 


8, 


9, 


8, 


10, 


10 


) 


( 


11. 


10, 


10, 


10, 


10, 


10, 


12, 


14, 


10, 


13 


) 


( 


10, 


10, 


10, 


12, 


10, 


12, 


11, 


11 , 


9, 


6 


) 


( 


11, 


10, 


15, 


10, 


12, 


8, 


10, 


8, 


11, 


10 


) 


( 


s, 


U, 


10, 


11, 


9, 


12, 


U, 


9, 


9, 


10 


) 


( 


10, 


10, 


10, 


10, 


12, 


8, 


10, 


6, 


10, 


14 


) 


( 


9, 


e, 


11, 


13, 


10, 


9, 


10, 


10, 


9, 


11 


) 


( 


6, 


u, 


11, 


11, 


7, 


10, 


10, 


11, 


13, 


10 


) 



Class 2 



( 


9, 


12, 


12, 


10, 


7, 


13, 


8, 


10, 


10, 


11 


) 


( 


12, 


8, 


11, 


10, 


10, 


10, 


10, 


10, 


12, 


10 


) 


( 


12, 


14, 


9, 


12, 


10, 


12, 


6, 


10, 


10, 


14 


) 


( 


11, 


10, 


10, 


11, 


11, 


11, 


10, 


9, 


8, 


6 


) 


( 


8, 


12, 


10, 


10, 


13, 


10, 


10, 


10, 


10, 


12 


) 


( 


8, 


8, 


10, 


13, 


9, 


10, 


9, 


9, 


6, 


12 


) 


( 


12, 


13, 


9, 


10, 


12, 


10, 


Q 

~ * 


9, 


13, 


6 


) 


( 


10, 


6, 


11, 


10, 


8, 


11, 


10, 


7, 


10, 


10 


) 


( 


8, 


11, 


8, 


U, 


11, 


12, 


12, 


11 , 


9, 


9 


) 


( 


10, 


9, 


10, 


9, 


10, 


12, 


10, 


8, 


8, 


8 


) 


( 


10, 


9, 


11, 


9, 


10, 


1, 


1, 


1, 


1, 


1 


) 


( 


10, 


9, 


10, 


11, 


8, 


9, 


10, 


10, 


11 , 


10 


) 


( 


9, 


9, 


9, 


8, 


10, 


10, 


12, 


10, 


9, 


15 


) 


( 


10, 


10, 


11, 


8, 


9, 


7, 


9, 


U, 


11, 


10 


) 


( 


12, 


10, 


12, 


10, 


10, 


9, 


10, 


10, 


10, 


10 


) 



/ 
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B. REFERENCE POINT TEST 



REFERENCE POINT I 2 





1. 


CASE 


1 






















a . 


I tera 


tion 


1 














( 


51, 


52, 


53, 


54, 


55, 


56, 


57, 


58, 


59, 


60 ) 


.004561 


( 


121, 


171, 


182, 


175, 


123, 


245 , 


186 , 


263, 


298, 


500 ) 


.005734 


( 


- 57, 


- 58, 


- 59, 


- 60, 


- 61,- 


- 62,- 


- 63,- 


- 64,- 


- 65, 


- 66 ) 


.005002 


( 


-501, 


-502, 


-503, 


-504, 


-505,- 


-506,- 


-5 37 , ■ 


-508,- 


-509. 


-510 ) 


.004654 


( 


0, 


-721 , 


-821 , 


-921, 


-111,- 


-211 ,- 


-311 ,■ 


-411,- 


-511, 


-611 ) 


.006724 



2. CASE 2 



a. Iteration 1 



( 


51, 


52, 


53, 


54, 


55, 


56, 


57, 


58, 


59, 


60 


) 


.024579 


( 


121, 


171, 


182, 


175, 


123, 


245, 


266, 


263, 


298, 


500 


) 


.034334 


( 


- 57,- 


- 58,- 


- 59,- 


- 60,- 


- 61,- 


- 62,* 


- 63,- 


- 64,- 


- 65,* 


- 66 


) 


.023966 


( 


-501,- 


-502,- 


-503,- 


-504,- 


-505,- 


-506,* 


-507,- 


-508,- 


-509,- 


-510 


\ 

J 


.023578 


( 


0,* 


-721,- 


-821,- 


-921,- 


-111,- 


-211,* 


-311,* 


-411,- 


-511,- 


-611 


) 


.032695 





3. 


CASE 


3 






















a . 


Itera 


tion 


1 














( 


51, 


52, 


53, 


54, 




56 , 


57, 


58, 


59, 


60 ) 


.063348 


( 


121, 


171, 


182, 


175, 


123, 


245, 


286, 


263, 


298, 


500 ) 


.078378 


( 


- 57, 


- 58, 


- 59, 


- 60, 


- 61,- 


- 62,- 


- 63,* 


- 64, 


- 65,- 


- 66 ) 


.063750 


( 


-501, 


-502, 


-503, 


-504, 


-505,- 


-506,* 


-507,- 


-508, 


-509,- 


-510 ) 


.062027 


( 


0, 


-721 , 


-821 , 


-921 , 


-111,- 


-211,- 


-311,- 


-411, 


-511,- 


-611 ) 


.075525 





4. 


CASE 


4 
























a . 


I tera 


tion 


1 
















( 


51, 


52, 


53 , 


54, 


55, 


56, 


57, 


58, 


59, 


60) 


20. 


.958557 


( 


121, 


171, 


182, 


175, 


123, 


245, 


286, 


263, 


298, 


500) 


23 


.204590 


( 


-57, 


-58, 


-59, 


-60, 


-61, 


-62, 


-63, 


-64, 


-65, 


-66) 


21 


.062271 


( 


-501, 


-502, 


-503, 


-504, 


-505,- 


-506,- 


-507,* 


-508,- 


-509,- 


-510’' 


21 . 


.051666 


( 


0, 


-721, 


-821 , 


-921, 


-111,- 


-211,- 


-311 ,- 


-411,- 


-511,- 


-611) 


17 


.253016 
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<T> <; 



0,-721,-821 ,-921,-111, 
0, -1,-821,-921,-111, 

0, -1,-821,-921,-111, 

0, -1,-821,-921,-111, 
0, -1,-821,-921,-111, 

c. Iteration 3 

0, -1,-821,-921,-111, 

0, -1,-821,-921,-111, 

0, -1,-821,-921,-111, 
0, -1,-821,-421,-111, 

0, -1,-221,-921,-111, 

d. Iteration 4 

0, -1,-821,-999,-111, 

0,-500,-821 ,-921 ,-111 , 
0, -1,-821,-921,-111, 

0, -1,-821,-921,-111, 

500, -1,-821,-921,-111, 

e. Iteration 5 

500, -1,-621,-219,-111, 

0, -1,-821,-219,-111, 

0, -1,-821,-219,-111, 

0, 0,-821,-219,-111, 

f. Iteration 6 

0, 200,-821,-921,-111, 
0, 200,-821,-219,-111, 
0, -1,-821,-921,-111, 

0, -1, 821,-921,-111, 

0, -1,-821,-921,-111, 

0, -1,-821,-921,-111, 

0, -1,-821,-921,-111, 
0, -1,-821,-219,-111, 

g. Iteration 7 

0, 800,-821,-921,-111, 
0, -1, 999,-921,-111, 

0, -1, 999,-921,-111, 

0, 800, 999,-921,-111, 
0, -1,-821,-921,-111, 

0, 800, 999,-921,-111, 
0, 800, 999,-921,-111, 



-211,-311,-411,-511, -1) 
-211,-311,-411,-511, -1) 
-211,-311 ,-411 ,-511, -€ 11) 
-900,-311,-411,-511,-611) 
-900,-311,-411,-511,-611) 



-900, 0,-411,-511, -1) 

900, 999,-411,-511, -1) 

900,-311,-411,-511, 500) 
900,-311,-411 ,-511,-611) 
900,-311,-411,-511,-611) 



999,-311,-411 ,-511,-611) 
900,-311,-411,-511,-611) 
900,-999,-411 ,-511,-611) 
900,-666,-411 ,-511,-611) 
900,-311,-411 ,-511,-611 ) 



900,-311 ,-411,-511 ,-611) 
900,-666,-411 ,-511,-611) 
900,-999,-411,-511,-611) 
900,-999,-411 ,-511 ,-611) 



900,-999,-411,-511,-611) 
900,-999,-411,-511,-611 ) 
900,-222,-411,-511,-611) 
900,-999,-411,-511,-611) 
900,-311 ,-411 ,-999,-611 ) 
900,-311,-411, 1,-611) 
900,-311,-411, 500,-611) 
900,-999,-411 ,-511 ,-611) 



900,-999,-411 ,-511 ,-611) 
900,-311,-411,-511,-611) 
900,-999,-411,-511,-611) 
900,-411 ,-411,-511,-611) 
900,-311,-411 ,-511,-999) 
900,-999,-411 ,-511 ,-999) 
900 ,-999,-999,-511 ,-999) 



14.781326 

13.008581 

12.028761 

9.707917 

15.126908 



19.077774 
29116 .8437 
18.246217 
13.567417 
51.881021 



13.752581 
15.657303 
8.724404 
10.710549 
15 .677859 



17 .799042 
11 .379161 
10.225633 
10.217400 



9.311914 
9.743191 
13.919784 
9.724404 
14.559681 
13.070512 
16 .673279 
10 .225633 



8.751494 
1364.4433 
59.601532 
40 .654962 
15.521662 
43 .365723 
31 .393661 



( 0 , 800 , 999 ,- 901 ,- 111 , 900 ,- 999 , 500 , - 51 1 , - 999 ) 
( 0 , 800 , 999 ,- 921 ,- 111 , 900 ,- 999 , 999 ,- 511 ,- 999 ) 
( 0 , 800 , 999 ,- 921 ,- 111 , 900 ,- 999 , 1 ,- 511 ,- 999 ) 
( 0 , 800 , 999 ,- 921 ,- 111 , 900 ,- 999 ,- 500 ,- 511 ,- 999 ) 

h. Iteration 8 

( 0 , 800 ,- 821 ,- 921 ,- 111 , 900 ,- 999 ,- 411 ,- 511 ,- 611 ) 
( 500 , 800 ,- 821 ,- 219 ,- 111 , 900 ,- 999 ,- 411 ,- 511 ,- 611 ) 
( 500 , - 1 ,- 821 ,- 921 ,- 111 , 900 ,- 311 ,- 411 ,- 511 ,- 611 ) 
( 999 , - 1 ,- 821 ,- 921 ,- 111 , 900 ,- 311 ,- 411 ,- 511 ,- 611 ) 
( 999 , 800 ,- 821 ,- 219 ,- 111 , 900 ,- 999 ,- 411 ,- 511 ,- 611 ) 
( 0 , 800 ,- 821 ,- 216 ,- 555 , 900 ,- 999 ,- 411 ,- 511 ,- 611 ) 
( 0 , 600 ,- 821 ,- 219 , 555 , 900 ,- 999 ,- 411 ,- 511 ,- 611 ) 



158 .365446 
11577 .5690 
64.88529 
40 .597549 



6.751494 
8.468982 
11.770139 
11.542337 
8 .294548 
9.677239 
9.246635 
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APPENDIX F TEST DATA FROM CASE STUDY 6 



A. SAMPLE DATA 

1. PHASE 1 : 46 SAMPLE 



( 

1 


a , 


to, 


c. 


d 


1 

( 


4, 


124, 


239, 


267 


( 


le. 


230, 


271 , 


264 


( 


is. 


230, 


271, 


265 


( 


2, 


225, 


239, 


266 


( 


190, 


101, 


237, 


268 


( 


8, 


227, 


239, 


266 


( 


10, 


227, 


271, 


265 


( 


4, 


225, 


272, 


266 


( 


39, 


233, 


262, 


264 


( 


32, 


231, 


263, 


265 


( 


19, 


227, 


264, 


266 


( 


26, 


229, 


263, 


266 


( 


29, 


230, 


264, 


266 


( 


24, 


230, 


265, 


268 


( 


16, 


227, 


267, 


269 


( 


8, 


124, 


267, 


268 



Class 2 



( 


1, 


115, 


239, 


268 


( 


191 , 


113, 


240, 


268 


( 


19, 


225, 


240, 


268 


( 


6 , 


225, 


269, 


265 


( 


191 , 


114, 


271 , 


266 


( 


2, 


122, 


270, 


266 


( 


6 , 


122, 


239, 


268 


( 


2, 


120 , 


271, 


266 


( 


19, 


228, 


234, 


269 


( 


32, 


232, 


237, 


270 


( 


34, 


232, 


235, 


270 


( 


27, 


231 , 


238, 


267 


( 


34, 


235, 


240, 


266 


( 


16, 


228, 


237, 


265 


( 


15, 


227, 


234, 


265 


( 


32, 


233, 


272, 


263 



» 


f , 


St 


h. 


i , 


J 


) 


♦ 


263 , 


262, 


260, 


261 , 


260 


) 


t 


261 , 


261 , 


259, 


260, 


260 


) 


f 


262, 


262, 


259, 


259, 


260 


) 


t 


262, 


261, 


260, 


260 , 


260 


) 


t 


263, 


262, 


261 , 


261 , 


260 


) 


f 


262, 


260, 


260, 


260, 


259 


) 


t 


262, 


260 , 


260, 


259, 


259 


) 


t 


263, 


261, 


260, 


260, 


260 


) 


* 


263, 


261, 


260, 


259, 


259 


) 


t 


259, 


260, 


2 59, 


258 , 


259 


) 


f 


261 , 


261 , 


259, 


258, 


259 


) 


f 


260, 


261, 


260, 


259 , 


259 


) 


t 


260, 


260, 


260, 


259, 


259 


) 


t 


260 , 


260, 


261 , 


259, 


259 


) 


t 


260, 


260, 


261, 


259, 


259 


) 


f 


262, 


261 , 


261, 


260 , 


259 


) 



t 


263, 


262, 


261, 


260, 


260 


) 


♦ 


263 , 


261 , 


261 , 


259, 


260 


) 


t 


265, 


262, 


262, 


259, 


261 


) 


t 


262, 


262, 


260, 


259, 


260 


) 


t 


263, 


262, 


260, 


259, 


260 


) 


f 


263 , 


262, 


259, 


259, 


260 


) 


t 


265, 


262, 


260, 


260, 


261 


) 


t 


264, 


261 , 


260, 


260, 


260 


) 


t 


267, 


259, 


262, 


259 , 


260 


) 


t 


264, 


259, 


262, 


260, 


260 


) 


t 


265, 


259, 


263, 


259, 


261 


) 


♦ 


264, 


259, 


262, 


258, 


260 


) 


t 


262, 


259, 


261, 


25e , 


260 


) 


f 


263, 


260, 


261 , 


259, 


260 


) 


t 


264, 


259, 


262, 


259 , 


261 


) 


f 


262, 


260, 


260, 


258, 


260 


) 



TEST 

e 

266 

264 

264 

265 

268 

264 

263 

263 

263 

263 

263 

263 

263 

264 

264 

263 

265 

263 

265 

265 

266 

264 

266 

264 

263 

264 

264 

263 

263 

263 

265 

264 



124 



Class 3 



( 


28, 


119, 


229, 


233, 


267 , 


265 , 


265, 


263, 


261 , 


261 


) 


( 


29, 


ue, 


253, 


232, 


268, 


265, 


264, 


264, 


260, 


263 


) 


( 


29, 


122, 


231 , 


232, 


269, 


265 , 


263 , 


264, 


260 , 


262 


) 


( 


31, 


123, 


232, 


233, 


270, 


265, 


263, 


264, 


261 , 


262 


) 


( 


35, 


124, 


232, 


233, 


271 , 


266, 


263, 


264, 


262, 


261 


) 


( 


40, 


225, 


232, 


233, 


271 , 


265, 


263, 


263, 


264 , 


258 


) 


( 


41, 


227, 


231, 


234, 


269, 


266, 


264, 


263, 


263, 


260 


) 


( 


40, 


226, 


233, 


277, 


239, 


266, 


264, 


260, 


264, 


262 


) 


( 


21, 


118, 


284, 


233, 


269, 


265, 


261 , 


266, 


260 , 


262 


) 


( 


23, 


122, 


227, 


234, 


267, 


265, 


261, 


266, 


259 , 


262 


) 


( 


19, 


117, 


226, 


235, 


266, 


265, 


261, 


266, 


259, 


262 


) 


( 


1?, 


104, 


226, 


236, 


265 , 


265 , 


264, 


265, 


259 , 


263 


) 


( 


4, 


92, 


227, 


236, 


266, 


264, 


266, 


263, 


261 , 


262 


) 


( 


1, 


86, 


226, 


239, 


266, 


264, 


266, 


261 , 


263 , 


260 


) 


( 


1, 


81, 


227, 


273, 


264 , 


265, 


267, 


260, 


262, 


262 


) 


( 


191, 


78, 


229, 


271 , 


264, 


266, 


266, 


260, 


2 62, 


261 


) 



2. PHASE 2 : 421 SAMPLE TEST 



Read each 


class mean as a 


column vector, 
class 




component 


1 


2 




a 


121.479 


49.766 


34.596 


b 


133.914 


188.723 


185.349 


c 


240.907 


242.022 


239.630 


d 


266.378 


263.657 


245.575 


e 


264.964 


264.482 


264.459 


f 


263.121 


263.350 


264.849 


g 


261.736 


261.562 


263.959 


h 


260.564 


260.693 


261.685 


i 


260.586 


260.058 


261.384 


j 


259.650 


260.095 


261.555 
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B. REFERENCE POINT TEST 



REFERENCE POINT 
1. 48 SAMPLE TEST 

a. Iteration 1 

( 9999, 9999, 9999, 9999, 9999, 

9999, 9999, 9999, 9999, 9999 ) 

( -9999, -9999, -9999, -9999, -9999, 

9999, -9999, -9999, -9999, -9999 ) 
( -5000, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
( -1000, -9999, -9999, -9999, -9999, 

-9999, -9999, -3999, -9999, -9999 ) 
( - 500, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
( 0, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
( 750, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
( 3000, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
( 7000, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 

b. ITERATION 2 

( -3000, -9999, -9999, -9999, -9999, 



1 .592025 
1 .551202 
1.034770 

0 .995774 
1 .014196 
1.035598 
1 .078592 

1 .269396 
1 .833402 
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-9999, -9999, -9999, -9999, 



-9999 ) 



3.974786 



( -2000, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, 
( -1503, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, 
( -1299, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, 
( - 900, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, 
( - 700, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, 



-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 



0 .975093 



0.982432 



0.990013 



0.998687 



1.005186 



c. ITERATION 3 



( -5000, 
( -3300, 
( -3500, 
( -3700, 
( -3900, 
( -4100, 



-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
—9999, —9999, —9999, —9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 



-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 



1.034770 



0 .978489 



0.981921 



0 .985854 



0 .991339 



0.997116 
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( -4400, -9999, -9999, -9999, -9999, 



-9999, -9999, -9999, -9999, -9999 ) 1.007870 



d. ITERATION 4 



( -9999, 
( -9999, 
( -9999, 
( -9999, 
( -9999, 
( -3000, 
( -9999, 
( -3000, 
( -3000, 
( -3000, 
( -3000, 



-5000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-1000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 

- 500, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
0, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
750, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
3000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
7000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-5000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-1000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 

- 500, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
0, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 



2 .563654 
7 .689868 
9 .428020 
11.793727 
17 .107452 
73 .984070 
50 .770370 
e .754902 
1 .226729 
1.515115 
1 .952134 
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( -3000, 750, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
( -3000, 3000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
( -3000, 7000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 



3.096567 



24.588181 



33 .357605 



e. ITERATION 5 



( -3000, 
( -3000, 
( -3000, 
( -3000, 
( -3000, 
( -3000, 
( -3000, 
( -3000, 
( -3000, 



-9500, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-9000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-8500, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-8000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-7500, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-7000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-6500, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-6000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-5500, -9999, -9999, -9999, 



0 .949582 
0.925911 
0.901211 
0 .876356 
0 .851815 
0 .828641 
0 .806097 
0 .785749 
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-9999, -9999, -9999, -9999, 



-9999 ) 



0 .768541 



( -3000, -4500, -9999, -9999, -9999 

-9999, -9999, -9999, -9999, -9999 ) 
( -3000, -4000, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 

f. ITERATION 6 



( -3000, 
( -3000, 
( -3000, 
( -3000, 
( -3000, 
( -3000, 
( -3000, 



-3600, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-3200, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-2800, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-2400, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-2200, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-1300, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
-1400, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 



g. ITERATION 7 



( -9999, -9999, -7000, -9999, -9999, 

-9999, -9999, -9999, -9999, -99^99 ) 



0.747745 
0 .747534 

0 .755150 
0 .772826 
0.601493 
0.847168 
0 .878674 

0 .956538 

1 .069383 

1.733785 
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( - 9999 , 
( - 9999 , 
( - 9999 , 
( - 9999 , 
( - 3090 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 



- 9999 , - 3003 , - 9999 , - 9999 , 
- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , - 1 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , 4000 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , 6000 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , - 7000 , - 9999 , - 9999 , 
- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , - 3000 , - 9999 , - 9999 , 
- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , - 1 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , 4000 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , 
- 4500 , 8000 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , 
- 4500 , - 7000 , - 9999 , - 9999 , 
- 9999 , - 9999 , - 9999 , - 9999 , 
- 4500 , - 3000 , - 9999 , - 9999 , 
- 9999 , - 9999 , - 9999 , - 9999 , 
- 4500 , - 1 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , 
- 4500 , 4000 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , 



-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 



2 .066772 
2.410366 
3 . 046544 
3 .992909 
1.071215 
1.261718 
1 .467927 
1 .674722 
2.517179 
0 .815090 
1.023657 
1.346619 
2.233199 
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( - 3000 , - 4500 , 8000 , - 9999 , - 9999 , 



- 9999 , - 9999 , - 9999 , - 9999 , -9999 ) 
h. ITERATION 8 



( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 
( - 3000 , 



- 4500 , - 9999 , 
- 9999 , -9999 
- 4500 , - 9999 , ■ 
- 9999 , -9999 
- 4500 , - 9999 , ■ 
- 9999 , -9999 
- 4500 , - 9999 , ■ 
- 9999 , -9999 
- 4500 , - 9999 , ■ 
- 9999 , -9999 
- 4500 , - 9999 , 
- 9999 , -9999 
- 4500 , - 9999 , 
- 9999 , -9999 
- 4500 , - 9999 , 
- 9999 , -9999 
- 4500 , - 9999 , 
- 9999 , -9999 
'- 4500 , - 9999 , • 
- 9999 , -9999 
- 4500 , - 9999 , ■ 



• 7000 , - 9999 , 
- 9999 , - 9999 , 
• 5000 , - 9999 , 
- 9999 , - 9999 , 
■ 3000 , - 9999 , 
- 9999 , - 9999 , 
• 1000 , - 9999 , 
- 9999 , - 9999 , 
1 , - 9999 , 
- 9999 , - 9999 , 
2000 , - 9999 , 
- 9999 , - 9999 , 
4000 , - 9999 , 
- 9999 , - 9999 , 
6000 , - 9999 , 
- 9999 , - 9999 , 
8000 , - 9999 , 
- 9999 , - 9999 , 
9000 , - 9999 , 
- 9999 , - 9999 , 
7000 , - 9999 , 



-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 
-9999 ) 



4.224475 

1 .772202 
1 .954675 
2.171665 
2.430396 
2.582221 
2.937319 
3.374505 
3.919746 
4.616714 
1 .552190 
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-9999, -9999, -9999, -9999, 
( -3000, -4500, -9999, -5000, -9999, 


-9999 ) 


1.553089 


-9999, -9999, -9999, -9999, 
( -3000, -4500, -9999, -3000, -9999, 


-9999 ) 


1.554962 


-9999, -9999, -9999, -9999, 
( -3300, -4530, -9999, -1003, -9999, 


-9999 ) 


1 .556623 


-9999, -9999, -9999, -9999, 
( -3000, -4500, -9999, - 1, -9999, 


-9999 ) 


1 .559961 


-9999, -9999, -9999, -9999, 
( -3000, -4500, -9999, 2000, -9999, 


-9999 ) 


1 .561696 


-9999, -9999, -9999, -9999, 
( -3003, -4500, -9999, 4000, -9999, 


-9999 ) 


1 .564777 


-9999, -9999, -9999, -9999, 
( -3000, -4500, -9999, 8000, -9999, 


-9999 ) 


1 .569691 


-9999, -9999, -9999, -9999, 
i. ITERATION 9 

( -9999, -9999, -9999, -9999, -9999, 


-9999 ) 


1 .580138 


-9000, -9999, -9999, -9999, 
( -9999, -9999, -9999, -9999, -9999, 


-9999 ) 


1 .543766 


-7000, -9999, -9999, -9999, 
( -9999, -9999, -9999, -9999, -9999, 


-9999 ) 


1.526525 


-5000, -9999, -9999, -9999, 
( -9999, -9999, -9999, -9999, -9999, 


-9999 ') 


1 .509349 


-3000, -9999, -9999, -9999, 


-9999 ) 


1 .492971 
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( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
- 1000 , - 9999 , - 9999 , - 9999 , 


-9999 ) 


1.477160 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 

1 , - 9999 , - 9999 , - 9999 , 


-9999 ) 


1 .468720 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
2000 , - 9999 , - 9999 , - 9999 , 


-9999 ) 


1 .452930 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
4000 , - 9999 , - 9999 , - 9999 , 


-9999 ) 


1 .437694 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
6000 , - 9999 , - 9999 , - 9999 , 


-9999 ) 


1 .422396 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
8000 , - 9999 , - 9999 , - 9999 , 


-9999 ) 


1 .407335 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , - 9000 , - 9999 , - 9999 , 


-9999 ) 


1.544096 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , - 7000 , - 9999 , - 9999 , 


-9999 ) 


1 .527735 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , - 5000 , - 9999 , - 9999 , 


-9999 ) 


1 .511520 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , - 3000 , - 9999 , - 9999 , 


-9999 ) 


1 .495849 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , - 1000 , - 9999 , - 9999 , 


-9999 ) 


1 .481759 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , - 1 , - 9999 , - 9999 , 


-9999 ) 


1 .474133 


( - 9999 , 


- 9999 , - 9999 , - 9999 , - 9999 , 
- 9999 , 2000 , - 9999 , - 9999 , 


-9999 ) 


1 .459345 
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( -9999, 



-9999, -9999, -9999, -9999, 



( -9999, 
( -9999, 
( -9999, 
( -9999, 
( -9999, 

( -9999, 
( -9999, 
( -9999, 
( -9999, 
( -9999, 
( -9999, 



-9999, 4000, -9999, -9999, -9999 ) 

-9999, -9999, -9999, -9999, 

-9999, 6000, -9999, -9999, -9999 ) 

-9999, -9999, -9999, -9999, 

-9999, 6000, -9999, -9999, -9999 ) 

-9999, -9999, -9999, -9999, 

-9999, -9999, -9000, -9999, -9999 ) 
-9999, -9999, -9999, -9999, 

-9999, -9999, -7000, -9999, -9999 ) 
-9999, -9999, -9999, -9999, 

-9999, -9999, -5000, -9999, -9999 ) 



1 .445719 



1 .431514 



1 .416290 



1 .543633 



1 .529631 



1 .464761 



. ITERATION 10 

1 



-9999, -9999, -9999, -9999, 

-9999, -9999, - 1, -9999, -9999 ) 

-9999, -9999, -9999, -9999, 

-9999, -9999, 2000, -9999, -9999 ) 

-9999, -9999, -9999, -9999, 

-9999, -9999, 4000, -9999, -9999 ) 

-9999, -9999, -9999, -9999, 

-9999, -9999, 6000, -9999, -9999 ) 

-9999, -9999, -9999, -9999, 

-9999, -9999, 6000, -9999, -9999 ) 

-9999, -9999, -9999, -9999, 



1 .477756 



1.464210 



1 .450755 



1 .437445 



1 .424325 
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- 9999 , - 9999 , - 9999 , - 9000 , 



-9999 ) 



1 .545251 



( - 9999 , 
( - 9999 , 
( - 9999 , 
( - 9999 , 
( - 9999 , 
( - 9999 , 
( - 9999 , 
( - 9999 , 
( - 9999 , 
( - 9999 , 
( - 9999 , 
{ - 9999 , 
( - 9999 , 



- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 7000 , -9999 
- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 5000 , -9999 
- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 3000 , -9999 
- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 1000 , -9999 
- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 1 , -9999 

- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 3999 , 2000 , -9999 

- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , 4000 , -9999 

- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , 6000 , -9999 

- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , 8000 , -9999 

- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , -9000 
- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , -7000 
- 9999 , - 9999 , - 9999 , - 9999 , 

- 9999 , - 9999 , - 9999 , - 9999 , -5000 
- 9999 , - 9999 , “ 9999 , - 9999 , 



) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 

) 



1 .532997 
1.520181 
1 .507595 
1 .495237 
1 .489653 
1 .478065 
1 .466319 
1 .455643 
1 .444137 
1 .547930 
1 .538848 
1.531022 
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1 .523348 



( -9999, 
( -9999, 
( -9999, 
( -9999, 
( -9999, 
( -9999, 



-9999, -9999, -9999, -9999, -3000 ) 
-9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -1003 ) 
-9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, - 1 ) 

-9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, 2000 ) 

-9999, -9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 4000 ) 

-9999, -9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 6000 ) 

-9999, -9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 8000 ) 



1.514919 
1 .510691 
1 .502452 
1 .494842 
1 .486907 
1.480084 



k. ITERATION 11 



( -3000, -4500, -9999, -9999, -9999, 

9999, 9999, 9999, 9999, 9999 ) 

( -3003, -4500, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
( -3000, -4500, -7000, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
( -3000, -4500, -7500, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 
( -3000, -4500, -8000, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 ) 



0.442269 



0.747745 



3.815093 



0 .800422 



0 .786349 
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( -3000, -4500, -7000, -9999, -9999, 



9999, 9999, 9999, 9999, 9999 ) 

( -3000, -4500, -7000, -9999, -9999, 

99999, 99999, 99999, 99999, 99999 ) 

2. 421 SAMPLE TEST 

a. ITERATION 1 

( -3000, -4500, -7000, -9999, -9999, 

99999, 99999, 99999, 99999, 99999 ) 
( -3000. -4500, -7000,-99999,-99999, 

99999, 99999, 99999, 99999, 99999 ) 



0.452415 

0.189089 

1 .578162 
1 .310979 
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APPENDIX G TEST DATA FROM CASE STUDY 7 



A. SAMPLE DATA 



The class means only are provided. Read each mean as a 
column vector . 



class 

vector 

component 123 



a 

b 

c 

d 

e 

f 

5 

h 

i 

J 

k 

1 

m 

n 

o 

P 

q 

r 

s 

t 

u 

V 

w 

X 



121.479 

133.914 

240.907 

266.378 
264.964 
263.121 
261.736 
260.564 
260.586 
259.650 
259.635 

258.836 
258.828 
258.621 
258.436 

258.378 
258.100 
258.100 
257.878 

257.836 
257.764 
257.678 
257.607 
257.421 
257.414 
257.343 
257.135 
257.200 
257.128 
257.107 
257.078 
257.050 



49.766 

188.723 

242.022 

263.657 

264.482 

263.350 

261.562 

260.693 

260.058 

260.095 
259.328 
259.073 
258.932 
258.606 
258.423 
258.233 
258.306 
257.963 
258.044 
257.613 
257.788 
257.576 
257.628 
257.343 
257.365 
257.292 
257.255 
257.219 

257.095 
257.102 
257.051 
257.095 



34.596 
185.349 
239.630 
245.575 
264.459 
264.849 
263.959 
261.685 
261 .384 
261.555 
263.373 
259.870 
259.609 
259.301 
259.185 
259.014 

259.021 
258.507 
258.322 
258.178 
258.164 
258.109 

258.021 
257.801 
257.829 
257.788 
257.774 
257.651 
257.637 
257.479 
257.418 
257.493 
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B. REFERENCE POINT FATA 



Read each reference point as a colurrn vector. The value 
of a vector component across a row remain constant unless 
indicated otherwise. The last component value change to 
occur remains in effect until modified. The resulting 
(I ) is shown below the corresponding vector. 



1. ITERATION 1 



-3000 

-4500 

-7000 

-9999 

-9999 

99999 

99999 

99999 


• • • 
• • • 
• • • 
• • • 
• • • 
• « • 
• • • 
• • • 


• • • 
• • • 
• • • 
• • • 
• • • 
• • • 
• • • 
• • • 


• • • 
• • • 
• • • 
• • • 
• • • 
• • • 
• • • 
• • • 


• • • 
• • • 
• • • 
• • • 
• • • 
• • • 
• • • 
• • • 


9999 


99999 


• • • 


9999 


• • • 


9999 


99999 


• • • 


9999 


• • • 


9999 


-9999 


99999 


9999 


. 99999 


9999 


-9999 


99999 


9999 


99999 


9999 


• * • 


• • • 


99999 


-9999 


9999 


• • • 


• • • 


• • • 


-99999 


9999 


• • • 


• • • 


• • • 


-99999 


9999 


• • « 


• • • 


♦ • • 


-99999 


9999 


• • • 


• • • 


99999 


99999 


9999 


• • • 


• • • 


99999 


99999 


9999 


• • • 


• • • 


-9999 


99999 


9999 


• • • 


• • • 


-9999 


99999 


9999 


• • • 


• • • 


-9999 


99999 


9999 


• ♦ • 


• • • 


-9999 


-99999 


9999 


• • • 


• • • 


-9999 


-99999 


9999 


• • • 


• • • 


-9999 


-99999 


9999 


• • • 


• • • 


-9999 


99999 


9999 


• • • 


• • • 


-9999 


99999 


9999 


• • • 


• • • 


-9999 


99999 


9999 


• • • 


• • • 


-9999 


99999 


9999 


• • • 


• • • 


-9999 


99999 


9999 


• • • 


• • • 


-9999 


-99999 


9999 


• • • 


• • • 


-9999 


-99999 


9999 


• • • 


• • • 


-9999 


-99999 


13573 


1 .£44750 


3.736396 


1 .896465 


54.177185 
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2. ITERATION 2 



s 

t 



-3000 

-4500 

-7000 

-9999 

-9999 

99999 

99999 

99999 

99999 

99999 

-6000 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 



U -9999 
v -9999 
v -9999 
X -9999 
y -9999 
z -9999 

* -9999 
9 -9999 

# -9999 
$ -9999 
% -9999 
& -9999 



-2000 



3000 



1.828800 1.74e404 1.877700 



7000 



.802315 
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3. ITERATION 3 



a 


-3000 


• • • 








b 


-4500 


• • • 








c 


-7000 


• • • 








d 


-9999 


• • • 








e 


-9999 


• • • 








f 


99999 


• • • 








S 


99999 


• • • 








h 


99999 


• • • 








i 


99999 


• • • 








J 


99999 


• • • 








k 


-9999 


• • • 








1 


-6000 


-2000 


3000 


7000 


-9999 


m 


-9999 


« • • 






-6000 



n -9999 

0 -9999 



-9999 
-9999 
-9999 

5 -9999 

t -9999 

u -9999 

v -9999 

w -9999 

1 -9999 

y -9999 

2 -9999 

* -9999 

0 -9999 

# -9999 

$ -9999 

% -9999 

6 -9999 



1.823965 1.772686 1.854467 1.785567 1.821434 



142 



O Qj «m ttf) xl i~* i— i E a O Pm o 4 t-t 



4. ITERATION 4 



a 

1 ) 



s 

t 

u 

V 

w 

z 

y 

z 

# 

0 

# 

$ 

% 

& 



-3000 

-4500 

-7000 

-9999 

-9999 

99999 

99999 

99999 

99999 

99999 

-9999 

-9999 

-2000 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 



3000 



7000 



-9999 

—6000 



1.763098 1.882494 1.795417 1.822107 



-2000 



1.754014 
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5 



ITERATION 5 



a -3000 

b -4500 

-7 000 
-9999 
-9999 
99999 
99999 
99999 
99999 
99999 
-9999 
-9999 
-9999 
3000 
-9999 
-9999 
-9999 
-9999 
S -9999 

t -9999 

U -9999 

v -9999 

v -9999 



I -9999 
y -9999 
z -9999 

* -9999 
0 -9999 

# -9999 
$ -9999 
% -9999 
S, -9999 



7000 -9999 

-9999 -6000 



-2000 



1.816326 1.762993 1.802553 1.762321 



3000 



1.868320 
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6. ITERATION 6 



a -3000 

b -4500 

-7000 
-9999 
-9999 
99999 
99999 
99999 
99999 
99999 
-9999 
-9999 
-9999 
-9999 

7000 -9999 

-9999 -6000 

-9999 
-9999 

5 -9999 

t -9999 

u -9999 

v -9999 

v -9999 

i -9999 

y -9999 

z -9999 

* -9999 

0 -9999 

# -9999 

$ -9999 

% -9999 

6 -9999 



-2000 



3000 



1.793631 1.789902 1.758676 



1 .803580 



7000 



1.771052 
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7. ITERATION 7 



-3300 

-4500 

-7000 

-9999 

-9999 

99999 

99999 

99999 

99999 

99999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-6000 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 



-2000 



3000 



1 .787084 



1.723260 1.908782 



7000 



.764592 
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8. ITERATION 8 



-1500 



-1000 






00 



-3000 
-4500 
-7000 
-999S 
-9999 
99999 
99999 
99999 
99999 
99999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-2000 
-9999 
t -9999 

u -9999 

v -9999 

w -9999 

x -9999 

y -9999 

z -9999 

* -9999 

0 -9999 

# -9999 

$ -9999 

% -9999 

& -9999 

1.734462 1.764483 



1.706574 1.782977 
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9. ITERATION 9 



s 

t 

u 

V 

w 

I 



-3000 

-4500 

-7000 

-9999 

-9999 

99999 

99999 

99999 

99999 

99999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-9999 

-3000 

-9999 

-9999 

-9999 

-9999 

-9999 



-2000 



-1000 



y -9999 

z -9999 

* -9999 

0 -9999 

# -9999 

$ -9999 

% -9999 

& -9999 



1.895550 1.733106 1.705211 



1 



1.811335 
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10. ITERATION 10 



s 

t 

u 

V 

w 

I 

7 

z 

¥ 

0 

# 

$ 

% 

& 



1 . 



-3000 


• • • 


-4500 


• • • 


-7000 


• • • 


-9999 


• • • 


-9999 


• • • 


99999 


• • • 


99999 


• • • 


99999 


• • • 


99999 


• • • 


99999 


• • • 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


-1000 


-2000 


644567 


1 .624708 
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